-- Logs begin at Thu 2022-05-26 12:56:00 UTC, end at Thu 2022-05-26 14:11:11 UTC. -- May 26 13:35:19.395645 dv-cinder-819668-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 13:35:19.403158 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 13:35:19 2022] *** May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: nodename: dv-cinder-819668-4-iscsi May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: machine: x86_64 May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: clock source: unix May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: pcre jit disabled May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: detected number of CPU cores: 4 May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: current working directory: / May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: detected binary path: /usr/bin/uwsgi-core May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: your processes number limit is 47680 May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: your memory page size is 4096 bytes May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: detected max file descriptor number: 2048 May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: lock engine: pthread robust mutexes May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: thunder lock: enabled May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 13:35:19.406823 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 13:35:19.452264 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: Python main interpreter initialized at 0x5647b7e2d9c0 May 26 13:35:19.452264 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: python threads support enabled May 26 13:35:19.452264 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: your server socket listen backlog is limited to 100 connections May 26 13:35:19.452264 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: your mercy for graceful operations on workers is 90 seconds May 26 13:35:19.452680 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: mapped 403077 bytes (393 KB) for 2 cores May 26 13:35:19.452759 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: *** Operational MODE: preforking *** May 26 13:35:19.452979 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: *** uWSGI is running in multiple interpreter mode *** May 26 13:35:19.452979 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: spawned uWSGI master process (pid: 109759) May 26 13:35:19.453198 dv-cinder-819668-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 13:35:19.456169 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: spawned uWSGI worker 1 (pid: 109760, cores: 1) May 26 13:35:19.456169 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: spawned uWSGI worker 2 (pid: 109761, cores: 1) May 26 13:35:19.456169 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 13:35:20.633468 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 13:35:20.653883 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 13:35:21.360038 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:35:21.360038 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: from cryptography.utils import int_from_bytes May 26 13:35:21.360428 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:35:21.360428 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: from cryptography.utils import int_from_bytes May 26 13:35:21.366622 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:35:21.366622 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: from cryptography.utils import int_from_bytes May 26 13:35:21.366956 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:35:21.366956 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: from cryptography.utils import int_from_bytes May 26 13:35:23.958722 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:35:23.959427 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:35:23.959559 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:35:23.959986 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:35:23.960138 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:35:23.960265 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:35:23.960265 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:35:23.960514 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:35:23.960626 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.960770 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:35:23.960873 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.960956 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:35:23.961222 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.961381 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.961530 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.961676 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.961817 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.961939 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.962084 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.962218 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.962382 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.962554 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.962709 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.962873 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.963041 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.963183 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.963313 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.963512 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.963650 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.963847 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.963982 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819668-4-iscsi {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.964117 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.964238 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.964462 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.964643 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.964765 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819668-4-iscsi {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.964986 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.965108 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.965263 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.965386 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.965519 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.965692 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.965828 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.966015 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.966139 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.966327 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.966553 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.967011 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.967011 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.967363 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.967363 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.967681 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.967865 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.968040 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.968207 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.968424 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.968620 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.968820 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.968968 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.969107 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.969251 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.969386 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.969517 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.969650 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.969796 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.969986 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.970173 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.970363 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.970553 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819668-4-iscsi {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.970730 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.970855 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.971051 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.971242 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.971429 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819668-4-iscsi {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.971599 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.971731 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.971924 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.972068 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.972214 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.972436 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.972565 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.972741 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.972935 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.973058 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.973242 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.973377 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.973501 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.973707 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.973844 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.973976 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.974108 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.974298 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.974436 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.974583 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.974709 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.974908 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.975034 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.975034 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.975336 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.975488 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.975618 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.975740 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.975875 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.976007 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.976150 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.976282 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.976482 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.976606 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.976789 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.976926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.977069 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.977204 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.977332 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.977478 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.977610 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.977734 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.977884 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.978027 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.978164 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.978288 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.978410 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.978546 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.978683 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.978824 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.979015 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.979140 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.979262 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.979451 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.979576 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.979698 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.979819 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.979953 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.980096 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.980228 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.980450 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.980581 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.980705 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.980825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.980958 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.981080 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.981200 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.981372 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.981496 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.981620 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.981764 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.981900 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.982023 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.982214 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.982348 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.982537 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.982675 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.982883 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.983006 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.983178 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.983301 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.983487 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.983620 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.983830 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.983955 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.984131 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.984269 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.984467 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.984595 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.984789 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.984929 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.985109 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.985233 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.985404 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.985529 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.985712 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.985847 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.986018 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.986142 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.986333 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.986456 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.986644 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.986767 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.986952 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.987085 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.987206 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.987337 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.987494 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.987617 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.987801 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.987937 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.988117 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.988247 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.988442 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.988583 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.988740 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.988881 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.989052 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.989197 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.989350 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.989485 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.989659 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.989800 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.990597 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.990729 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.990869 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.991002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.991213 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.991510 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.991645 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.991790 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.991913 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.992047 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.992191 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.992397 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.992542 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.992665 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.992791 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.992913 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.993046 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.993166 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.993288 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.993473 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.993595 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.993780 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.993919 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.994095 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.994219 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.994402 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.994524 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.994708 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.994842 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.995018 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.995160 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.995321 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.995444 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.995627 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.995778 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.995945 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.996085 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.996249 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.996424 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.996582 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.996729 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.996893 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.997017 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.997201 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.997327 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.997510 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.997644 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.997820 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.997944 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.998125 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.998257 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.998435 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.998571 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.998740 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.998863 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.999053 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.999188 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.999387 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.999510 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.999649 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.999784 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:23.999946 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.000084 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.000257 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.000448 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.000570 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.000694 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.000877 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.001016 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.001184 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.001316 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.001485 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.001670 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.001796 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.001928 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.002081 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.002205 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.002404 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.002530 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.002709 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.002842 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.003016 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.003141 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.003325 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.003448 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.003633 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.003773 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.003957 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:35:24.004090 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.004295 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.004458 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.004653 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.004791 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.004989 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.005115 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.005289 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.005411 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.006212 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.006342 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.006578 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.006726 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.006896 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.007024 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.007213 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.007349 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.007531 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.007657 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.007846 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.007972 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.008161 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.008286 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.008506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.008630 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.008823 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.008970 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.009149 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.009314 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.009495 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.009618 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.009770 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.009908 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.010091 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.010215 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.010390 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.010516 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.010709 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.010838 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.011021 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.011160 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.011344 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.011529 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.011653 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.011791 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.011984 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.012114 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.012297 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.012462 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.012664 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.012883 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.013006 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.013144 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.013307 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.013471 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.013620 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.013761 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.013937 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.014062 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.014247 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.014373 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.014561 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.014699 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.014878 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.015004 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.015193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.015327 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.015520 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.015653 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.015832 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.015958 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.016145 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.016280 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.016491 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.016616 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.016782 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.016918 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.017092 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.017228 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.017408 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.017533 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.017725 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.017852 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.018040 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.018166 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.018356 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.018482 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.018674 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.018798 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.018979 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.019120 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.019286 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.019412 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.019606 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.019778 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.019926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.020086 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.020222 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.020388 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.020513 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.020655 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.020813 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.020966 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.021168 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.021350 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.021485 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.021608 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.021744 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.021917 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.022059 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.022212 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.022379 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.022502 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.022656 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.022795 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.022997 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.023219 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.023404 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.023559 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.023730 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.023886 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.024040 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.024206 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.024422 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.024549 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.024695 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.024817 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.024944 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.025071 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.025208 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.025334 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.025472 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.025598 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.025735 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.025858 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.026013 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.026138 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.026320 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.026445 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.026626 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.026762 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.026941 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.027084 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.027250 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.027374 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.027562 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.027685 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.027874 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.028011 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.028182 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.028343 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.028529 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.028655 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.028845 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.028996 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.029160 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.029296 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.029487 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.029615 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.029811 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.029979 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.030135 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.030271 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.030424 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.030590 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.030751 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.030872 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.031055 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.031179 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.031364 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.031443 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.031641 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.031801 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.031956 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.032080 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.032254 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.032432 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.032611 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.032735 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.032894 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.033018 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.033204 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.033285 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.033429 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.033540 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.033741 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.033880 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.034038 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.034175 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.034329 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.034454 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.034634 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.034769 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.034930 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.035065 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.035234 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.035371 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.035545 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.035728 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.035851 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.035993 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.036148 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.036284 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.036483 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.036609 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.036845 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.036991 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.037267 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.037392 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.037562 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.037687 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.037900 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.038026 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.038227 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.038352 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.038544 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.038669 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.038858 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.038985 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.039173 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.039310 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.039487 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.039611 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.039805 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.039958 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.040099 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.040221 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.040437 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.040566 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.040759 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.040883 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.041073 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.041199 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.041400 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.041632 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.041756 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.041881 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.042006 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.042130 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.042311 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.042448 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.042631 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.042768 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.042938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.043073 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.043268 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.043423 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.043600 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.043719 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.043930 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.044051 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.044244 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.044411 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.044588 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.044700 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.044905 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.045038 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.045220 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.045362 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.045527 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.045670 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.045846 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.046026 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.046192 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.046346 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.046502 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.046658 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.046813 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.046967 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.047141 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.047305 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.047463 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.047617 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.047781 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.047937 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.048101 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.048255 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.048425 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.048549 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.048681 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.048824 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.048965 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.049086 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.049231 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.049365 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.049499 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.049641 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.049813 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.049937 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.050128 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.050255 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.050435 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.050580 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.050746 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.050870 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.051058 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.051182 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.051362 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.051499 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.051674 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.051796 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.051964 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.052100 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.052293 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.053014 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.053139 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.053266 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.053541 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.053672 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.053863 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.053994 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.054174 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.054311 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.054485 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.054611 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.054792 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.054917 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.055100 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.055225 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.055408 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.055533 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.055718 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.055854 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.056036 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.056177 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.056378 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.056506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.056694 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.056829 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.057000 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.057135 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.057307 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.057432 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.057629 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.057755 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.057938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.058075 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.058242 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.058378 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.058548 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.058672 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.058854 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.059003 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.059160 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.059296 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.059469 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.059605 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.059788 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.059922 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.060110 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.060265 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.060442 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.060564 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.060749 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.060874 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.061062 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.061186 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.061371 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.061515 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.061680 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.061869 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.062006 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.062130 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.062284 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.062411 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.062595 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.062721 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.062904 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.063030 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.063214 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.063338 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.063543 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.063745 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.063887 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.064009 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.064135 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.064262 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.064436 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.064559 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.064765 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.064888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.065076 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.065199 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.065379 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.065525 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.065690 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.065824 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.066000 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.066126 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.066320 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.066582 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.066713 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.066917 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.067194 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.067323 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.067536 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.067695 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.067839 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.067967 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.068210 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.068394 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.068542 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.068666 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.068869 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.068996 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.069205 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.069332 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.069512 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.069727 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.069863 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.070013 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.070158 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.070344 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.070468 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.070609 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.070745 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.070881 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.071005 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.071129 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.071292 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.071425 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.071597 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.071747 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.071895 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.072032 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.072201 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.072356 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.072514 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.072650 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.072819 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.072956 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.073124 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.073251 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.073429 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.073556 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.073737 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.073882 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.074046 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.074171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.074354 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.074541 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.074665 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.074792 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.074961 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.075087 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.075260 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.075385 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.075565 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.075700 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.075869 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.076007 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.076171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.076297 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.076548 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.076672 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.076838 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.076977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.077148 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.077275 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.077490 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.077617 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.077799 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.077936 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.078106 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.078233 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.078432 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.078559 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.078737 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.078861 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.079044 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.079179 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.079348 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.079473 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.079655 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.079790 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.079961 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.080085 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.080556 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.080682 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.080852 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.080977 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.081158 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.081282 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.081465 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.081589 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.081776 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.081900 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.082082 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.082217 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.082388 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.082526 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.082690 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.082815 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.083002 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.083128 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.083310 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.083447 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.083617 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.084266 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.084492 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.084633 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.084804 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.084946 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.085161 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.085294 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.085434 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.085559 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.085714 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.085854 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.086016 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.086178 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.086328 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.086512 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.086652 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.086775 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.086925 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.087052 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.087232 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.087368 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.087536 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.087660 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.087842 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.087965 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.088147 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.088283 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.088465 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.088597 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.088774 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.088916 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.089086 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.089222 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.089392 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.089517 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.089698 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.089823 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.090000 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.090137 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.090306 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.090432 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.090612 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.090745 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.090916 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.091054 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.091229 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.091354 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.091529 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.091663 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.091839 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.091976 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.092149 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.092283 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.092508 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.092650 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.092776 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.092920 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.093055 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.093178 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.093341 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.093464 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.093641 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.093769 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.093945 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.094069 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.094251 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.094379 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.094552 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.094676 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.094860 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.095007 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.095160 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.095287 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.095488 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.095610 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.095739 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.095877 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.096042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.096188 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.096389 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.096525 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.096705 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.096873 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.097052 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.097196 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.097370 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.097492 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.097656 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.097780 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.097975 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.098113 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.098285 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.098421 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.098595 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.098720 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.098908 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.099045 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.099210 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.099432 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.099602 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.099727 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.099923 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.100063 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.100245 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.100397 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.100588 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.100741 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.100917 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.101112 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.101270 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.101426 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.101582 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.101746 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.101910 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.102067 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.102232 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.102417 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.102551 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.102688 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.102824 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.102950 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.103111 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.103235 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.103361 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.103488 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.103662 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.103788 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.103977 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.104103 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.104296 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.104456 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.104633 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.104770 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.104946 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.105084 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.105254 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.105401 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.105566 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.105694 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.105875 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.106012 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.106185 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.106327 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.106491 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.106617 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.106807 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.106956 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.107112 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.107251 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.107416 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.107551 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.107727 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.107880 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.108033 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.108168 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.108371 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.108504 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.108660 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.108782 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.108949 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.109072 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.109224 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.109350 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.109529 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.109663 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.109866 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.109990 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.110176 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.110304 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.110560 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.110686 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.110848 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.110995 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.111152 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.111234 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.111457 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.111592 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.111758 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.111881 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.112066 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.112193 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.112400 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.112558 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.112757 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.112927 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.113084 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.113239 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.113415 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.113611 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.113736 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.113865 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.114018 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.114143 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.114327 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.114466 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.114637 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.114763 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.115471 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.115756 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.115881 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.116021 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.116273 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.116466 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.116594 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.116721 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.116924 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.117050 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.117204 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.117331 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.117532 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.117669 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.117842 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.117980 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.118169 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.118300 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.118541 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.118676 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.118897 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.119062 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.119196 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.119330 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.119557 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.119691 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.119881 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.120005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.120205 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.120359 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.120565 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.120707 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.120871 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.120996 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.121188 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.121364 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.121506 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.121629 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.121804 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.121954 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.122119 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.122257 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.122426 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.122551 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.122746 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.122903 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.123039 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.123178 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.123355 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.123482 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.123661 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.123798 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.123977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.124146 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.124283 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.124472 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.124629 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.124772 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.124933 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.125088 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.125334 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.125461 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.125638 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.125782 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.125968 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.126158 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.126315 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.126469 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.126634 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.126791 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.126928 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.127103 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.127271 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.127436 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.127614 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.127776 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.127941 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.128097 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.128273 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.128470 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.128612 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.128748 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.128883 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.129019 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.129145 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.129289 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.129415 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.129543 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.129679 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.129810 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.129941 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.130092 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.130216 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.130343 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.130469 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.130644 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.130802 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.131060 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.131190 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.131405 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.131550 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.131725 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.131851 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.132044 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.132168 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.132369 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.132494 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.132678 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.132899 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.133061 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.133239 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.133399 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.133564 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.133735 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.134004 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.134163 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.134329 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.134329 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.134668 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.134668 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.134992 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.134992 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.135308 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.135484 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.135643 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.135815 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.136075 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.136075 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.136400 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.136400 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.136649 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.136649 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.136906 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.137034 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.137159 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.137298 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.137423 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.137561 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.137686 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.137814 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.137950 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.138084 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.138208 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.138347 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.138469 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.138597 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.138738 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.138863 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.139002 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.139152 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.139282 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.139410 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.139550 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.139687 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.139824 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.139949 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.140075 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.140201 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.140354 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.140598 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.140743 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.140913 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.141054 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.141219 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.141357 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.141545 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.141694 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.141829 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.141967 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.142134 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.142258 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.142436 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.142572 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.142743 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.142937 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.143088 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.143224 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.143379 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.143508 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.143695 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.143823 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.144005 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.144132 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.144384 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.144514 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.144662 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.144794 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.144969 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.145110 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.145290 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.145451 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.145588 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.145712 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.145900 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.146027 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.146741 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.146878 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.147059 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.147187 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.147370 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.147532 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.147669 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.147858 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.147985 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.148181 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.148328 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.148522 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.148835 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.148963 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.149152 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.149277 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.149468 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.149607 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.149782 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.150012 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.150139 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.150346 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.150476 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.150665 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.150793 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.150986 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.151117 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.151294 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.151434 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.151607 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.151743 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.151915 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.152054 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.152229 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.152405 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.152580 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.152707 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.152894 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.153071 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.153197 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.153343 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.153523 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.153653 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.153836 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.153977 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.154156 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.154285 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.154469 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.154616 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.154797 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.154926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.155114 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.155244 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.155433 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.155562 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.155746 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.155884 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.156061 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.156200 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.156414 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.156544 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.156703 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.156860 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.157016 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.157160 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.157333 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.157468 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.157647 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.157776 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.157957 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.158098 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.158267 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.158394 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.158580 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.158707 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.158896 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.159021 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.159213 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.159347 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.159529 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.159659 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.159845 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.159977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.160156 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.160298 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.160478 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.160601 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.160794 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.160922 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.161168 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.161307 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.161487 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.161626 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.161842 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.162034 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.162333 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.162476 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.162661 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.162892 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.163022 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.163230 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.163366 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.163570 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.163698 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.163901 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.164037 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.164210 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.164384 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.164544 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.164677 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.164903 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.165039 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.165162 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.165376 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.165500 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.165627 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.165760 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.165895 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.166068 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.166207 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.166387 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.166513 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.166696 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.166822 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.167030 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.167215 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.167373 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.167573 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.167753 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.167910 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.168076 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.168242 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.168476 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.168604 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.168803 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.168929 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.169144 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.169269 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.169464 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.169590 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.169774 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.169901 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.170084 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.170210 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.170402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.170546 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.170716 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.170841 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.171023 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.171148 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.171329 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.171456 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.171640 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.171779 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.171975 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.172106 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.172235 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.172398 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.172574 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.172724 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.172880 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.173005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.173197 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.173355 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.173481 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.173619 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.173791 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.173929 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.174097 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.174225 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.174403 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.174542 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.174746 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.174877 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.175015 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.175137 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.175311 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.175441 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.175614 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.175750 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.175926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.176053 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.176231 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.176434 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.176560 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.176688 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.176853 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.176981 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.177164 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.177297 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.177483 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.177703 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.177842 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.177969 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.178110 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.178234 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.178389 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.178515 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.178705 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.178843 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.179013 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.179139 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.179326 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.179455 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.179686 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.179828 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.180007 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.180133 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.180330 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.180459 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.180643 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.180783 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.180959 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.181093 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.181281 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.181409 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.181609 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.181818 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.181947 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.182155 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.182288 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.182475 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.182614 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.182810 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.182938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.183144 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.183394 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.183526 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.183733 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.183881 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.184042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.184190 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.184389 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.184520 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.184702 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.184830 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.185015 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.185142 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.185329 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.185466 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.185637 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.185773 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.185948 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.186075 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.186257 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.186396 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.186569 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.186700 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.186876 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.187003 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.187186 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.187376 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.187502 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.187641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.187794 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.187939 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.188103 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.188245 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.188437 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.188567 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.188749 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.188874 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.189063 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.189191 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.189377 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.189504 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.189691 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.189828 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.190005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.190132 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.190321 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.190447 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.190634 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.190762 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.190945 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.191075 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.191257 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.191386 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.191567 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.191714 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.191887 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.192016 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.192198 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.192390 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.192524 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.192667 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.192824 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.192998 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.193652 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.193783 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.193966 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.194117 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.194339 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.194475 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.194609 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.194740 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.194949 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.195074 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.195300 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.195428 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.195628 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.195770 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.195949 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.196079 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.196272 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.196488 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.196615 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.196746 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.196922 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.197062 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.197252 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.197380 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.197576 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.197726 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.197902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.198082 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.198250 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.198374 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.198510 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.198665 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.198791 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.198918 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.199087 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.199213 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.199408 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.199557 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.199719 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.199848 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.200022 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.200169 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.200372 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.200505 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.200638 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.200785 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.200942 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.201074 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.201228 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.201361 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.201536 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.201671 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.201842 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.201970 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.202150 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.202345 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.202473 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.202612 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.202738 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.202865 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.203038 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.203173 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.203343 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.203479 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.203646 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.203786 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.203952 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.204083 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.204255 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.204413 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.204583 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.204726 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.204887 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.205011 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.205452 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.205578 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.205757 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.205895 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.206060 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.206184 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.206362 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.206497 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.206673 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.206823 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.206960 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.207086 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.207268 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.207396 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.207577 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.207728 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.207912 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.208039 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.208228 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.208421 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.208564 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.208727 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.208936 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.209074 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.209264 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.209389 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.209594 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.209721 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.209909 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.210036 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.210237 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.210363 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.210565 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.210692 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.210883 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.211010 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.211198 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.211336 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.211509 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.211635 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.211822 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.211949 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.212141 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.212279 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.212486 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.212612 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.212785 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.212910 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.213095 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.213238 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.213410 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.213548 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.213730 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.213855 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.214050 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.214178 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.214358 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.214486 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.214687 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.214824 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.215002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.215129 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.215312 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.215439 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.215629 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.215824 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.215961 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.216086 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.216246 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.216442 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.216569 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.216709 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.216890 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.217018 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.217207 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.217345 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.217519 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.217665 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.217834 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.217961 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.218157 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.218305 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.218482 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.218622 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.218822 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.218957 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.219115 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.219238 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.219463 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.219607 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.219792 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.219918 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.220109 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.220236 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.220444 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.220574 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.220752 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.220879 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.221007 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:35:24.221221 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.221571 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.221930 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.222250 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.222562 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:35:24.222807 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:35:24.283123 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO dbcounter [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Registered counter for database nova_api May 26 13:35:24.284787 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO dbcounter [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Registered counter for database nova_api May 26 13:35:24.304223 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:35:24.305781 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_db.sqlalchemy.engines [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:35:24.310972 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writer thread running {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:35:24.312332 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writer thread running {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:35:24.370060 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.context [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11d24607-eb88-459e-b6ca-9c71caaa8fb1(cell1) {{(pid=109761) load_cells /opt/stack/nova/nova/context.py:464}} May 26 13:35:24.371232 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.context [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11d24607-eb88-459e-b6ca-9c71caaa8fb1(cell1) {{(pid=109760) load_cells /opt/stack/nova/nova/context.py:464}} May 26 13:35:24.374172 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG oslo_concurrency.lockutils [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:35:24.375333 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:35:24.375736 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG oslo_concurrency.lockutils [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:35:24.376563 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG oslo_concurrency.lockutils [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:35:24.376963 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:35:24.377756 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:35:24.378538 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG oslo_concurrency.lockutils [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:35:24.379741 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:35:24.380546 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO dbcounter [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Registered counter for database nova_cell0 May 26 13:35:24.381805 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO dbcounter [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Registered counter for database nova_cell0 May 26 13:35:24.384611 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO dbcounter [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Registered counter for database nova_cell1 May 26 13:35:24.385937 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO dbcounter [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Registered counter for database nova_cell1 May 26 13:35:24.391717 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:35:24.394794 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_db.sqlalchemy.engines [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:35:24.396857 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writer thread running {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:35:24.397756 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:35:24.400565 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_db.sqlalchemy.engines [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:35:24.401872 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writer thread running {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:35:24.541675 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writer thread running {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:35:24.546347 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writer thread running {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:35:24.550536 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO dbcounter [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Registered counter for database nova_cell0 May 26 13:35:24.555371 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO dbcounter [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Registered counter for database nova_cell0 May 26 13:35:24.557897 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG oslo_db.sqlalchemy.engines [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:35:24.562738 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writer thread running {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:35:24.564072 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_db.sqlalchemy.engines [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:35:24.568590 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writer thread running {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:35:24.911518 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: WARNING keystonemiddleware.auth_token [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:35:24.913615 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: WARNING keystonemiddleware.auth_token [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:35:24.916987 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: WARNING keystonemiddleware.auth_token [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:35:24.921438 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: WARNING keystonemiddleware.auth_token [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:35:25.266350 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: WARNING keystonemiddleware.auth_token [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:35:25.273428 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: WARNING keystonemiddleware.auth_token [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:35:25.278709 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647b7e2d9c0 pid: 109760 (default app) May 26 13:35:25.280822 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:35:25.282014 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001798 May 26 13:35:25.282416 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Thu May 26 13:35:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:35:25.290531 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: WARNING keystonemiddleware.auth_token [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:35:25.296511 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: WARNING keystonemiddleware.auth_token [None req-a5c8b745-70ba-44b3-ba20-4823d793dbd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:35:25.303098 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5647b7e2d9c0 pid: 109761 (default app) May 26 13:36:45.080901 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:36:45.080901 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 May 26 13:36:45.080901 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:36:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:36:45.103975 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writing DB stats nova_api:SELECT=3 {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:36:45.105260 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writing DB stats nova_cell1:SELECT=3 {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:36:45.105978 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writing DB stats nova_cell0:SELECT=3 {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:36:45.106904 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:36:45.572253 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-f601811b-40f4-43df-aecf-e9d8c431ee44 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:36:45.604860 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-f601811b-40f4-43df-aecf-e9d8c431ee44 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.506118 May 26 13:36:45.605636 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Thu May 26 13:36:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:36:47.960860 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:36:47.961857 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-87cdf392-4aac-4c64-95c7-6dbc18900c01 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 26 13:36:47.962248 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:36:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:36:48.024467 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1a1dfaf5-bbd2-4d9c-a96e-dd51532358b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "vcpus": 1, "disk": 1, "name": "cirros256"}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:48.043095 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:36:48.043095 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: warnings.warn(msg) May 26 13:36:48.074489 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-1a1dfaf5-bbd2-4d9c-a96e-dd51532358b6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105909 May 26 13:36:48.076193 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:36:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:36:48.304911 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-6338bc77-c04e-4d4d-ae94-c722986b0fec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:48.307471 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:36:48.307471 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: warnings.warn(msg) May 26 13:36:48.310382 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_api:SELECT=3 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:36:48.311265 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_cell0:SELECT=3 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:36:48.312157 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_cell1:SELECT=3 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:36:48.312896 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:36:48.378407 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-6338bc77-c04e-4d4d-ae94-c722986b0fec admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293781 May 26 13:36:48.379327 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Thu May 26 13:36:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:36:50.706204 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1a1dfaf5-bbd2-4d9c-a96e-dd51532358b6 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:36:50.707238 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-1a1dfaf5-bbd2-4d9c-a96e-dd51532358b6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003159 May 26 13:36:50.707656 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:36:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:36:50.827815 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-f9279fe7-2b85-4119-a638-b0ec92b90490 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "name": "ds512M", "disk": 5, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:50.848123 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:36:50.848123 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: warnings.warn(msg) May 26 13:36:50.869308 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-f9279fe7-2b85-4119-a638-b0ec92b90490 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154770 May 26 13:36:50.869877 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:36:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:36:50.882809 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-a10c70a7-7607-4a4c-8531-2ed90a8c0ca4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:50.884398 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:36:50.884398 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: warnings.warn(msg) May 26 13:36:50.919891 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-a10c70a7-7607-4a4c-8531-2ed90a8c0ca4 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040924 May 26 13:36:50.920713 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Thu May 26 13:36:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:36:53.240813 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-f9279fe7-2b85-4119-a638-b0ec92b90490 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:36:53.242445 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-f9279fe7-2b85-4119-a638-b0ec92b90490 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 May 26 13:36:53.242855 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:36:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:36:53.308700 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-17ec5db3-86d9-4b5f-b566-e60541b92dd0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "name": "ds1G", "disk": 10, "ram": 1024, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:53.329016 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-17ec5db3-86d9-4b5f-b566-e60541b92dd0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079798 May 26 13:36:53.332373 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:36:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:36:53.342182 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-2364fce4-4fb2-4a4f-82b5-1f6dd5bf4533 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:53.367411 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-2364fce4-4fb2-4a4f-82b5-1f6dd5bf4533 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029040 May 26 13:36:53.368468 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Thu May 26 13:36:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:36:55.709480 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-17ec5db3-86d9-4b5f-b566-e60541b92dd0 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:36:55.710494 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-17ec5db3-86d9-4b5f-b566-e60541b92dd0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 26 13:36:55.710892 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:36:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:36:55.771833 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-f798422b-ecf4-4f3d-a337-409267bf2c2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "id": "d3", "name": "ds2G", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:55.789673 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-f798422b-ecf4-4f3d-a337-409267bf2c2e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072988 May 26 13:36:55.790222 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:36:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:36:55.802477 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-d53e4674-0f50-486f-8e65-4da5b8f27c23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:55.826265 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-d53e4674-0f50-486f-8e65-4da5b8f27c23 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027626 May 26 13:36:55.827116 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Thu May 26 13:36:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:36:58.173813 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-f798422b-ecf4-4f3d-a337-409267bf2c2e admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:36:58.174726 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-f798422b-ecf4-4f3d-a337-409267bf2c2e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 26 13:36:58.175278 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:36:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:36:58.256235 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-c9dc249f-1e79-4ef0-9787-26dbda78fe01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:58.285528 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-c9dc249f-1e79-4ef0-9787-26dbda78fe01 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.103781 May 26 13:36:58.286136 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:36:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:36:58.298728 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-cab8c3e3-4bed-4228-addc-61f317dd9db3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:36:58.327224 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-cab8c3e3-4bed-4228-addc-61f317dd9db3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032682 May 26 13:36:58.328178 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Thu May 26 13:36:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:37:00.639509 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-c9dc249f-1e79-4ef0-9787-26dbda78fe01 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:00.640734 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-c9dc249f-1e79-4ef0-9787-26dbda78fe01 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 May 26 13:37:00.641578 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:00.713288 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-e2d2cd43-eb1d-4c62-b702-3c829c7de047 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:00.747708 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-e2d2cd43-eb1d-4c62-b702-3c829c7de047 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.099475 May 26 13:37:00.749804 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Thu May 26 13:37:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:37:03.143349 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-c9dc249f-1e79-4ef0-9787-26dbda78fe01 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:03.144543 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-c9dc249f-1e79-4ef0-9787-26dbda78fe01 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 May 26 13:37:03.145008 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:37:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:03.224458 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-2b019402-a30f-4f52-9509-b6ea8372723f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:03.244539 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-2b019402-a30f-4f52-9509-b6ea8372723f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.090843 May 26 13:37:03.245104 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:37:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:37:03.262935 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-b896a5db-fdee-4537-8f4c-a76e1f091b8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:03.291176 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-b896a5db-fdee-4537-8f4c-a76e1f091b8e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032330 May 26 13:37:03.291871 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Thu May 26 13:37:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:37:05.936542 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-2b019402-a30f-4f52-9509-b6ea8372723f admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:05.937371 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-2b019402-a30f-4f52-9509-b6ea8372723f admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 26 13:37:05.937936 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:37:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:37:06.003699 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-6e94b4a9-f9e4-4adb-8621-e2e718131c9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:06.021627 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-6e94b4a9-f9e4-4adb-8621-e2e718131c9b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076797 May 26 13:37:06.022217 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:37:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:37:06.034839 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-9a3f7138-a6ec-453c-a659-5fb2b48d4952 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:06.060769 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-9a3f7138-a6ec-453c-a659-5fb2b48d4952 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030075 May 26 13:37:06.063705 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Thu May 26 13:37:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:37:08.407826 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-6e94b4a9-f9e4-4adb-8621-e2e718131c9b admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:08.408881 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-6e94b4a9-f9e4-4adb-8621-e2e718131c9b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002087 May 26 13:37:08.409292 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:37:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:08.479070 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-1802bfee-0de9-4659-9333-5e229d03da1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "id": "3", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:08.497684 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-1802bfee-0de9-4659-9333-5e229d03da1c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078106 May 26 13:37:08.498315 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:37:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:37:08.510433 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-a4e1fb60-8445-4b53-9a70-358043b719db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:08.534705 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-a4e1fb60-8445-4b53-9a70-358043b719db admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027870 May 26 13:37:08.535453 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Thu May 26 13:37:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:37:10.887895 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-1802bfee-0de9-4659-9333-5e229d03da1c admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:10.889042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-1802bfee-0de9-4659-9333-5e229d03da1c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 26 13:37:10.889337 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:10.948005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-01e9347b-9549-43b7-96f6-4d42ecaa81f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:10.966147 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-01e9347b-9549-43b7-96f6-4d42ecaa81f7 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070409 May 26 13:37:10.967034 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:37:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:37:10.979050 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-485b6196-8856-4f75-8fda-fdeb6368c86c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:11.003665 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-485b6196-8856-4f75-8fda-fdeb6368c86c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028205 May 26 13:37:11.004154 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Thu May 26 13:37:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:37:13.378331 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-01e9347b-9549-43b7-96f6-4d42ecaa81f7 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:13.379346 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-01e9347b-9549-43b7-96f6-4d42ecaa81f7 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 26 13:37:13.379745 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:13.448995 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-63fc6f17-0d30-424f-b046-4162f5c21f15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:13.471781 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-63fc6f17-0d30-424f-b046-4162f5c21f15 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.084754 May 26 13:37:13.472470 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Thu May 26 13:37:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:37:13.484327 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-c053e799-bfb1-4651-bcf4-03bd45dcf6e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:13.512340 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-c053e799-bfb1-4651-bcf4-03bd45dcf6e9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031583 May 26 13:37:13.513221 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Thu May 26 13:37:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:37:38.703266 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-63fc6f17-0d30-424f-b046-4162f5c21f15 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:38.704560 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-63fc6f17-0d30-424f-b046-4162f5c21f15 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002250 May 26 13:37:38.704959 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:37:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:38.715617 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:37:38.765362 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-8dbbfa18-0d41-4df3-ba7f-cd6a693c0c6e admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:38.784503 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-8dbbfa18-0d41-4df3-ba7f-cd6a693c0c6e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073237 May 26 13:37:38.785053 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Thu May 26 13:37:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:37:39.789215 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-63fc6f17-0d30-424f-b046-4162f5c21f15 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:39.790251 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-63fc6f17-0d30-424f-b046-4162f5c21f15 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 26 13:37:39.790649 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:39.997372 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-6fd3de12-df1e-453f-bc3f-4c900400cadc admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:40.003668 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.wsgi [None req-6fd3de12-df1e-453f-bc3f-4c900400cadc admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-6fd3de12-df1e-453f-bc3f-4c900400cadc admin admin] Request method failure captured: May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Accept: application/json May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Accept-Encoding: gzip, deflate May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Connection: keep-alive May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Content-Length: 0 May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Host: 10.222.0.16 May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Openstack-Api-Version: compute 2.90 May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Openstack-System-Scope: None May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: User-Agent: python-novaclient May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Auth-Token: gAAAAABij4KjWctWf8qzITQubbhtCqcymPX4pB-Fr-AGEMSlcQRk_2UxIGH-ouua9AXkLDRlnezmGaNQNlLVfqG7MaycBvj04zd281JCQqNfJK99T6q7bI3xFDj3rINsH60MUFaQ-veh9Fds4eRfK87KeQXgAnYY9wkGq74-KXUfasCZsp330nM May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Domain-Id: None May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Domain-Name: None May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Identity-Status: Confirmed May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Is-Admin-Project: True May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Domain-Id: default May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Domain-Name: Default May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Name: admin May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Role: reader,admin,member May 26 13:37:40.006964 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Roles: reader,admin,member May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56278f94460f422387fbeb96048d2270", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56278f94460f422387fbeb96048d2270"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant: admin May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant-Name: admin May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User: admin May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Domain-Id: default May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Domain-Name: Default May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Id: 8243f73b32484519bc2bed2bc9edc57e May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Name: admin May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: method: > May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: exception: Flavor 42 could not be found. May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: action_args: {'id': '42'} May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:37:40.008641 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:40.009759 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:40.010938 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-6fd3de12-df1e-453f-bc3f-4c900400cadc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:37:40.011999 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-6fd3de12-df1e-453f-bc3f-4c900400cadc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064120 May 26 13:37:40.011999 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Thu May 26 13:37:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:37:40.018410 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-3e7b8bec-6ce1-4151-aa60-e075b3f5a780 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:40.021297 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:37:40.041826 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-3e7b8bec-6ce1-4151-aa60-e075b3f5a780 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027080 May 26 13:37:40.042402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Thu May 26 13:37:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:37:40.052736 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-efc53505-98ff-429c-8b06-534ddb08e9da admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:40.074809 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-efc53505-98ff-429c-8b06-534ddb08e9da admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025570 May 26 13:37:40.075375 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Thu May 26 13:37:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:37:40.085714 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-fb2c1bd0-732b-45e3-a65f-2edc8b10064b admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:40.092536 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.wsgi [None req-fb2c1bd0-732b-45e3-a65f-2edc8b10064b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-fb2c1bd0-732b-45e3-a65f-2edc8b10064b admin admin] Request method failure captured: May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Accept: application/json May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Accept-Encoding: gzip, deflate May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Connection: keep-alive May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Content-Length: 0 May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Host: 10.222.0.16 May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Openstack-Api-Version: compute 2.90 May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Openstack-System-Scope: None May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: User-Agent: python-novaclient May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Auth-Token: gAAAAABij4KjWctWf8qzITQubbhtCqcymPX4pB-Fr-AGEMSlcQRk_2UxIGH-ouua9AXkLDRlnezmGaNQNlLVfqG7MaycBvj04zd281JCQqNfJK99T6q7bI3xFDj3rINsH60MUFaQ-veh9Fds4eRfK87KeQXgAnYY9wkGq74-KXUfasCZsp330nM May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Domain-Id: None May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Domain-Name: None May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Identity-Status: Confirmed May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Is-Admin-Project: True May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Domain-Id: default May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Domain-Name: Default May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Name: admin May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Role: reader,admin,member May 26 13:37:40.095907 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Roles: reader,admin,member May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56278f94460f422387fbeb96048d2270", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56278f94460f422387fbeb96048d2270"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant: admin May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant-Name: admin May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User: admin May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Domain-Id: default May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Domain-Name: Default May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Id: 8243f73b32484519bc2bed2bc9edc57e May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Name: admin May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: method: > May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: exception: Flavor 42 could not be found. May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: action_args: {'id': '42'} May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:37:40.098361 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:40.099825 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:40.101926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-fb2c1bd0-732b-45e3-a65f-2edc8b10064b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:37:40.103894 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-fb2c1bd0-732b-45e3-a65f-2edc8b10064b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015240 May 26 13:37:40.103894 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Thu May 26 13:37:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:37:40.985718 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-efc53505-98ff-429c-8b06-534ddb08e9da admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:40.987214 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-efc53505-98ff-429c-8b06-534ddb08e9da admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 May 26 13:37:40.987912 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:41.178304 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-d0fdb1cc-08ba-4ce2-ab00-892d9a8c01c4 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:41.184254 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.wsgi [None req-d0fdb1cc-08ba-4ce2-ab00-892d9a8c01c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-d0fdb1cc-08ba-4ce2-ab00-892d9a8c01c4 admin admin] Request method failure captured: May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Accept: application/json May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Accept-Encoding: gzip, deflate May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Connection: keep-alive May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Content-Length: 0 May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Host: 10.222.0.16 May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Openstack-Api-Version: compute 2.90 May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Openstack-System-Scope: None May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: User-Agent: python-novaclient May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Auth-Token: gAAAAABij4KkvqtpU-Xabt4n0BCN1Z-8eEP2kLuGvN2XZSWJYHg3DC-AkoV_vCp70CkNQ7x5aaaJXP9WdFA4tM8_9Bz--maB02Ad_3pOGY9gWeGqrLY6DHLoTydgajV7YJPwmw77sGxH3TyEcyqZcXUNkrd809UMM6WxnW2uhdMd7FgRHxl-e1c May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Domain-Id: None May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Domain-Name: None May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Identity-Status: Confirmed May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Is-Admin-Project: True May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Domain-Id: default May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Domain-Name: Default May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Name: admin May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Role: reader,admin,member May 26 13:37:41.185763 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Roles: reader,admin,member May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56278f94460f422387fbeb96048d2270", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56278f94460f422387fbeb96048d2270"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant: admin May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant-Name: admin May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User: admin May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Domain-Id: default May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Domain-Name: Default May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Id: 8243f73b32484519bc2bed2bc9edc57e May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Name: admin May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: method: > May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: exception: Flavor 84 could not be found. May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: action_args: {'id': '84'} May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:37:41.187977 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:41.188902 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:41.190002 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-d0fdb1cc-08ba-4ce2-ab00-892d9a8c01c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:37:41.191062 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-d0fdb1cc-08ba-4ce2-ab00-892d9a8c01c4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063784 May 26 13:37:41.191062 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Thu May 26 13:37:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:37:41.197723 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-a5682410-c8f7-487f-8605-2736b0895a8f admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:41.214528 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-a5682410-c8f7-487f-8605-2736b0895a8f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020341 May 26 13:37:41.215085 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Thu May 26 13:37:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:37:41.224771 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-11a5c1fc-878a-4760-8107-7f7362ba3ea6 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:41.239307 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-11a5c1fc-878a-4760-8107-7f7362ba3ea6 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018023 May 26 13:37:41.239862 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Thu May 26 13:37:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:37:41.249984 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-7a5cf92e-5abe-4d1d-89df-a0b940e22ec9 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:41.258004 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.wsgi [None req-7a5cf92e-5abe-4d1d-89df-a0b940e22ec9 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-7a5cf92e-5abe-4d1d-89df-a0b940e22ec9 admin admin] Request method failure captured: May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Accept: application/json May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Accept-Encoding: gzip, deflate May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Connection: keep-alive May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Content-Length: 0 May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Host: 10.222.0.16 May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Openstack-Api-Version: compute 2.90 May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Openstack-System-Scope: None May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: User-Agent: python-novaclient May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Auth-Token: gAAAAABij4KkvqtpU-Xabt4n0BCN1Z-8eEP2kLuGvN2XZSWJYHg3DC-AkoV_vCp70CkNQ7x5aaaJXP9WdFA4tM8_9Bz--maB02Ad_3pOGY9gWeGqrLY6DHLoTydgajV7YJPwmw77sGxH3TyEcyqZcXUNkrd809UMM6WxnW2uhdMd7FgRHxl-e1c May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Domain-Id: None May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Domain-Name: None May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Identity-Status: Confirmed May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Is-Admin-Project: True May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Domain-Id: default May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Domain-Name: Default May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Name: admin May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Role: reader,admin,member May 26 13:37:41.259888 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Roles: reader,admin,member May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56278f94460f422387fbeb96048d2270", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56278f94460f422387fbeb96048d2270"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant: admin May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant-Name: admin May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User: admin May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Domain-Id: default May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Domain-Name: Default May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Id: 8243f73b32484519bc2bed2bc9edc57e May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Name: admin May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: method: > May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: exception: Flavor 84 could not be found. May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: action_args: {'id': '84'} May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:37:41.261821 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:41.262864 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:41.264171 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-7a5cf92e-5abe-4d1d-89df-a0b940e22ec9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:37:41.266098 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-7a5cf92e-5abe-4d1d-89df-a0b940e22ec9 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015529 May 26 13:37:41.266098 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Thu May 26 13:37:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:37:42.138853 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-11a5c1fc-878a-4760-8107-7f7362ba3ea6 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:42.139919 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-11a5c1fc-878a-4760-8107-7f7362ba3ea6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 26 13:37:42.140332 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:37:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:42.333215 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1f1b7526-8af8-4ca0-9d59-cd9e31d4f312 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:42.338941 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.wsgi [None req-1f1b7526-8af8-4ca0-9d59-cd9e31d4f312 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1f1b7526-8af8-4ca0-9d59-cd9e31d4f312 admin admin] Request method failure captured: May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Accept: application/json May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Accept-Encoding: gzip, deflate May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Connection: keep-alive May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Content-Length: 0 May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Host: 10.222.0.16 May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Openstack-Api-Version: compute 2.90 May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Openstack-System-Scope: None May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: User-Agent: python-novaclient May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Auth-Token: gAAAAABij4KmE5MOyVYioIm0fyffgwoJl6s0IxnimRMz84uNtfPsYlXhqpcJ_CYq5N1wv_ifWqutYaIkCZmMwpTgddEV5JYgAPGHhuzvZOgW_Er3CJ2IC-L2KJRRpeWkdYUCBa2GVehHDDDQsGO3BQuXinHcspfZIjHCFKcoWY5LjWsYVa4QyPU May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Domain-Id: None May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Domain-Name: None May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Identity-Status: Confirmed May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Is-Admin-Project: True May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Domain-Id: default May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Domain-Name: Default May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Project-Name: admin May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Role: reader,admin,member May 26 13:37:42.340446 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Roles: reader,admin,member May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56278f94460f422387fbeb96048d2270", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56278f94460f422387fbeb96048d2270"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant: admin May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-Tenant-Name: admin May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User: admin May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Domain-Id: default May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Domain-Name: Default May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Id: 8243f73b32484519bc2bed2bc9edc57e May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: X-User-Name: admin May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: method: > May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: exception: Flavor 451 could not be found. May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: action_args: {'id': '451'} May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:37:42.342005 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:42.343094 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: ERROR nova.api.openstack.wsgi May 26 13:37:42.344506 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1f1b7526-8af8-4ca0-9d59-cd9e31d4f312 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:37:42.345767 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-1f1b7526-8af8-4ca0-9d59-cd9e31d4f312 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062716 May 26 13:37:42.345767 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Thu May 26 13:37:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:37:42.351612 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-6be92d7c-6aea-4850-a004-52be0a43fa69 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:42.367406 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-6be92d7c-6aea-4850-a004-52be0a43fa69 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019178 May 26 13:37:42.367958 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Thu May 26 13:37:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:37:42.378353 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:42.392555 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018496 May 26 13:37:42.393096 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Thu May 26 13:37:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:37:42.402374 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-e4bef1ca-86c7-4c8a-ae94-9c76647ae832 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:42.407878 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.wsgi [None req-e4bef1ca-86c7-4c8a-ae94-9c76647ae832 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-e4bef1ca-86c7-4c8a-ae94-9c76647ae832 admin admin] Request method failure captured: May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Accept: application/json May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Accept-Encoding: gzip, deflate May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Connection: keep-alive May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Content-Length: 0 May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Host: 10.222.0.16 May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Openstack-Api-Version: compute 2.90 May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Openstack-System-Scope: None May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: User-Agent: python-novaclient May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Auth-Token: gAAAAABij4KmE5MOyVYioIm0fyffgwoJl6s0IxnimRMz84uNtfPsYlXhqpcJ_CYq5N1wv_ifWqutYaIkCZmMwpTgddEV5JYgAPGHhuzvZOgW_Er3CJ2IC-L2KJRRpeWkdYUCBa2GVehHDDDQsGO3BQuXinHcspfZIjHCFKcoWY5LjWsYVa4QyPU May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Domain-Id: None May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Domain-Name: None May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Identity-Status: Confirmed May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Is-Admin-Project: True May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Openstack-Nova-Api-Version: 2.90 May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Domain-Id: default May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Domain-Name: Default May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Project-Name: admin May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Role: reader,admin,member May 26 13:37:42.409402 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Roles: reader,admin,member May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_56278f94460f422387fbeb96048d2270", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/56278f94460f422387fbeb96048d2270"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/56278f94460f422387fbeb96048d2270"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant: admin May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant-Id: 56278f94460f422387fbeb96048d2270 May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-Tenant-Name: admin May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User: admin May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Domain-Id: default May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Domain-Name: Default May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Id: 8243f73b32484519bc2bed2bc9edc57e May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: X-User-Name: admin May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: method: > May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: exception: Flavor 451 could not be found. May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: action_args: {'id': '451'} May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:37:42.411042 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:42.412193 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: ERROR nova.api.openstack.wsgi May 26 13:37:42.413522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-e4bef1ca-86c7-4c8a-ae94-9c76647ae832 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:37:42.414790 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-e4bef1ca-86c7-4c8a-ae94-9c76647ae832 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011994 May 26 13:37:42.414790 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Thu May 26 13:37:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 13:37:43.281875 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:43.283794 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 26 13:37:43.283794 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:37:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:37:43.476119 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-26fd9d7f-4a08-49c6-a060-b78b6d79d78b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:43.496167 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-26fd9d7f-4a08-49c6-a060-b78b6d79d78b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.078226 May 26 13:37:43.496806 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Thu May 26 13:37:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:37:44.390970 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:44.392139 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002389 May 26 13:37:44.392636 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:44.583930 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-3f13093f-b1d5-4c67-a72d-292eba9e5a8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:44.602072 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-3f13093f-b1d5-4c67-a72d-292eba9e5a8e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070221 May 26 13:37:44.602524 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Thu May 26 13:37:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:37:45.473035 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:45.474026 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 26 13:37:45.474421 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:37:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:45.664979 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-98541b60-50fc-42c6-8284-c26a1bd02c01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:45.681897 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-98541b60-50fc-42c6-8284-c26a1bd02c01 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068775 May 26 13:37:45.682436 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Thu May 26 13:37:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:37:46.566289 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:46.567297 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 26 13:37:46.567698 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:46.758744 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-66e0faa3-1b96-459b-ba79-36e390033628 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:37:46.776581 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-66e0faa3-1b96-459b-ba79-36e390033628 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070611 May 26 13:37:46.777113 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Thu May 26 13:37:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:37:47.654267 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:47.655286 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 26 13:37:47.655696 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:37:47.848424 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-563afd5d-0a23-4a1b-9532-49800532c28f admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:37:47.868021 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-563afd5d-0a23-4a1b-9532-49800532c28f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073486 May 26 13:37:47.868587 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Thu May 26 13:37:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:38:51.017799 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:38:51.018818 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-db9d69c3-f43f-4e01-98bc-9c6b54391679 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 26 13:38:51.019219 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Thu May 26 13:38:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:38:51.027254 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:51.081348 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-f28e075b-24c9-488a-8e4c-27de1c15752d admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:38:51.101163 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-f28e075b-24c9-488a-8e4c-27de1c15752d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075795 May 26 13:38:51.101700 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Thu May 26 13:38:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:38:51.123290 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG dbcounter [-] [109761] Writing DB stats nova_api:SELECT=14 {{(pid=109761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:38:51.127406 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-e2543eea-d424-491c-93c0-7a9235502e86 admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:38:51.134886 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-e2543eea-d424-491c-93c0-7a9235502e86 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013029 May 26 13:38:51.135406 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Thu May 26 13:38:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:38:51.147718 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-eff36928-3b16-4c13-a02b-a070e0c67a1d admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:38:51.155500 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-eff36928-3b16-4c13-a02b-a070e0c67a1d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011366 May 26 13:38:51.156134 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Thu May 26 13:38:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:38:51.168334 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:38:51.176348 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012516 May 26 13:38:51.176828 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Thu May 26 13:38:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:38:51.191256 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-9218e922-994d-47c2-9b0a-c8c4fdbf4863 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:38:51.199508 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-9218e922-994d-47c2-9b0a-c8c4fdbf4863 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011210 May 26 13:38:51.200030 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Thu May 26 13:38:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:42:35.030142 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:42:35.031187 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 26 13:42:35.032102 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:42:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:42:35.190926 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_api:SELECT=6 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:35.311035 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-c251b6ce-3f3f-4e49-9d15-34d8bcd02aed admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:42:35.312250 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:42:35.312250 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: warnings.warn(msg) May 26 13:42:35.314270 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-c251b6ce-3f3f-4e49-9d15-34d8bcd02aed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:42:35.314745 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-c251b6ce-3f3f-4e49-9d15-34d8bcd02aed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:42:35.315522 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-c251b6ce-3f3f-4e49-9d15-34d8bcd02aed admin admin] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:42:35.315957 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-c251b6ce-3f3f-4e49-9d15-34d8bcd02aed admin admin] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:42:35.351694 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-c251b6ce-3f3f-4e49-9d15-34d8bcd02aed admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.162079 May 26 13:42:35.352270 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Thu May 26 13:42:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:42:36.243306 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:42:36.244338 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 26 13:42:36.244724 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:42:36.439826 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-b0a3cec8-9ae4-47ea-828a-802b0d48cc69 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:42:36.441059 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:42:36.441059 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: warnings.warn(msg) May 26 13:42:36.442234 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-b0a3cec8-9ae4-47ea-828a-802b0d48cc69 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:42:36.442670 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-b0a3cec8-9ae4-47ea-828a-802b0d48cc69 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:42:36.443586 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-b0a3cec8-9ae4-47ea-828a-802b0d48cc69 admin admin] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:42:36.444056 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-b0a3cec8-9ae4-47ea-828a-802b0d48cc69 admin admin] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:42:36.465296 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-b0a3cec8-9ae4-47ea-828a-802b0d48cc69 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079107 May 26 13:42:36.465822 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Thu May 26 13:42:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:42:47.791712 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:42:47.792789 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 26 13:42:47.793176 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:42:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:42:47.938596 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_cell0:SELECT=4 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:47.939309 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_cell1:SELECT=4 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:47.939921 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG dbcounter [-] [109760] Writing DB stats nova_api:SELECT=8 {{(pid=109760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:47.994531 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-e3329ae6-20c7-4ae3-a516-a81eeb3c6274 admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:42:47.995714 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:42:47.995714 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: warnings.warn(msg) May 26 13:42:47.996937 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-e3329ae6-20c7-4ae3-a516-a81eeb3c6274 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:42:47.997388 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-e3329ae6-20c7-4ae3-a516-a81eeb3c6274 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:42:47.998184 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-e3329ae6-20c7-4ae3-a516-a81eeb3c6274 admin admin] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:42:47.998614 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-e3329ae6-20c7-4ae3-a516-a81eeb3c6274 admin admin] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:42:48.024369 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-e3329ae6-20c7-4ae3-a516-a81eeb3c6274 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090092 May 26 13:42:48.024947 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Thu May 26 13:42:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:42:48.907948 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: DEBUG nova.api.openstack.wsgi [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] Calling method '>' {{(pid=109761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:42:48.909006 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: INFO nova.api.openstack.requestlog [None req-1db3df83-2689-4f2d-8bd7-04e9e89af9cd admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 May 26 13:42:48.909431 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: [pid: 109761|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Thu May 26 13:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:42:49.103991 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG nova.api.openstack.wsgi [None req-86c110e9-8428-4378-a171-7df43143887f admin admin] Calling method '>' {{(pid=109760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:42:49.105203 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 13:42:49.105203 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: warnings.warn(msg) May 26 13:42:49.106596 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-86c110e9-8428-4378-a171-7df43143887f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:42:49.107045 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-86c110e9-8428-4378-a171-7df43143887f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:42:49.107950 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-86c110e9-8428-4378-a171-7df43143887f admin admin] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:42:49.108415 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: DEBUG oslo_concurrency.lockutils [None req-86c110e9-8428-4378-a171-7df43143887f admin admin] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:42:49.132683 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: INFO nova.api.openstack.requestlog [None req-86c110e9-8428-4378-a171-7df43143887f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082762 May 26 13:42:49.133186 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: [pid: 109760|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Thu May 26 13:42:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:43:47.102920 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: Thu May 26 13:43:47 2022 - graceful shutdown triggered... May 26 13:43:47.103469 dv-cinder-819668-4-iscsi devstack@n-api.service[109761]: Gracefully killing worker 2 (pid: 109761)... May 26 13:43:47.103830 dv-cinder-819668-4-iscsi devstack@n-api.service[109760]: Gracefully killing worker 1 (pid: 109760)... May 26 13:43:47.105257 dv-cinder-819668-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 13:43:48.104090 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: worker 1 buried after 1 seconds May 26 13:43:48.104090 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: worker 2 buried after 1 seconds May 26 13:43:48.104090 dv-cinder-819668-4-iscsi devstack@n-api.service[109759]: goodbye to uWSGI. May 26 13:43:48.106870 dv-cinder-819668-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 13:43:48.107516 dv-cinder-819668-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 13:43:48.110480 dv-cinder-819668-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 13:43:48.124393 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 13:43:48 2022] *** May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: nodename: dv-cinder-819668-4-iscsi May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: machine: x86_64 May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: clock source: unix May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: pcre jit disabled May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: detected number of CPU cores: 4 May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: current working directory: / May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: detected binary path: /usr/bin/uwsgi-core May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: your processes number limit is 47680 May 26 13:43:48.140154 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: your memory page size is 4096 bytes May 26 13:43:48.141117 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: detected max file descriptor number: 2048 May 26 13:43:48.141117 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: lock engine: pthread robust mutexes May 26 13:43:48.141117 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: thunder lock: enabled May 26 13:43:48.141117 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 13:43:48.141117 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 13:43:48.186975 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: Python main interpreter initialized at 0x55fde29669c0 May 26 13:43:48.186975 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: python threads support enabled May 26 13:43:48.186975 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: your server socket listen backlog is limited to 100 connections May 26 13:43:48.186975 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: your mercy for graceful operations on workers is 90 seconds May 26 13:43:48.187388 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: mapped 403077 bytes (393 KB) for 2 cores May 26 13:43:48.187388 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: *** Operational MODE: preforking *** May 26 13:43:48.187674 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: *** uWSGI is running in multiple interpreter mode *** May 26 13:43:48.187674 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: spawned uWSGI master process (pid: 124220) May 26 13:43:48.187877 dv-cinder-819668-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 13:43:48.188946 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: spawned uWSGI worker 1 (pid: 124240, cores: 1) May 26 13:43:48.189492 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: spawned uWSGI worker 2 (pid: 124241, cores: 1) May 26 13:43:48.189805 dv-cinder-819668-4-iscsi devstack@n-api.service[124220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 13:43:49.380027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 13:43:49.385124 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 13:43:50.203128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:43:50.203128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: from cryptography.utils import int_from_bytes May 26 13:43:50.203455 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:43:50.203455 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: from cryptography.utils import int_from_bytes May 26 13:43:50.203606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:43:50.203606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: from cryptography.utils import int_from_bytes May 26 13:43:50.203731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 13:43:50.203731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: from cryptography.utils import int_from_bytes May 26 13:43:52.714343 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:43:52.715429 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:43:52.715746 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:43:52.716082 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:43:52.716373 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:43:52.716773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.717106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.717435 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.717760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.718093 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.718409 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.718736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.719063 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.719396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.719660 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.719980 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.720327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819668-4-iscsi {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.720653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.720967 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.721281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.721605 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.721913 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.722239 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.722549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.723067 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.727723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.727723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.727723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.727723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.727723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.727723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.727723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.727723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819668-4-iscsi {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.728916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.729069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.729399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.731304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.731304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.731304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.731304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.731683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.731920 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.732604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.732604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.732927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.733178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.733492 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.733746 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.734064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.734393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.734717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.735048 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.735305 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.735558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.735883 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.736209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.736546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.736863 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.737177 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.737488 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.737800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.738113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.738423 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.738734 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.739060 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.739381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.739711 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.740026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.740370 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.740782 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.741038 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.741352 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.741749 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.742025 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.742340 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.742665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.742992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.743304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.743618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.743930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.744247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.744621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.744930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.745187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.745493 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.745805 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.746172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.746488 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.746912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.747381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.747695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.748006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.748380 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.748659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.748972 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.749283 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.749593 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.749904 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.750215 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.750525 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.750851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.751174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.751497 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.751937 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.752103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.752442 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.752771 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.753081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.753391 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.753717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.754039 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.754404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.754724 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.754961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.755282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.755605 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.755909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.756217 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.756565 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.756882 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.757187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.757498 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.757804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.758117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.758423 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.758730 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.759039 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.759345 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.759671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.760000 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.760331 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.760695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.760963 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.761287 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.761637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.762143 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.762479 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.762897 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.763242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.763582 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.763909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.764228 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.764624 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.764941 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.765218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.765538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.765855 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.766183 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.766509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.766845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.767169 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.767498 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.767822 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.768133 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.768483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.769276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.769276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.769568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.769777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.770132 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.770451 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.770851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.771113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.771435 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.771761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.772076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.772557 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.772831 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.773075 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.773382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.773791 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.774212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.774645 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.774645 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.775567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.775567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.775567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.776262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.776262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.776788 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.776788 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.777285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.778011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.778474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.778850 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.779648 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.779907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 13:43:52.780742 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 13:43:52.780997 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.780997 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.781420 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 13:43:52.781595 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.781759 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 13:43:52.781908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.782108 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 13:43:52.782301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.782458 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.782785 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.782940 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.783095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.783437 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.783620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.783767 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.784043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.784349 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.784550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.784806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.784986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.785348 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.785639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.785790 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.785949 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.786095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.786241 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.786385 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.786539 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.786697 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.786875 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.787052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819668-4-iscsi {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.787212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.787411 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.787564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.787729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.787908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.788102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.788290 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.788473 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.788639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.788838 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.788987 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.789151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.789307 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.789476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.789704 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.789704 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.790010 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.790176 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.790323 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.790468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.790645 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.790857 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.791081 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.791294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.791533 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.791755 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.791985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.792219 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.792529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.792790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.793186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.793365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.793623 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.793876 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.794251 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.794546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.794722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.795012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.795178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819668-4-iscsi {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.795544 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.796396 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.796566 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.796983 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.797140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.797302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.797466 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.797631 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.797781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.798072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.798235 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.798391 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.798536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.798536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.798826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.798981 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.799137 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.799290 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.799434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.799585 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.799741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.799908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.800061 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.800214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.800390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.800542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.800704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.800853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.800997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.801149 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.801294 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.801446 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.801613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.801816 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.801996 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.802152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.802304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.802304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.802597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.802743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.802887 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.803040 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.803347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.803516 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.803516 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.803804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.803950 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.803950 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.804294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.804543 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.804543 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.804855 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.805021 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.805021 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.805446 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.805797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.805797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.806171 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.806329 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.806329 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.806625 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.806771 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.806771 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.807061 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.807214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.807214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.807497 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.807650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.807650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.807944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.808097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.808256 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.808438 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.808594 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.808915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.809130 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.809321 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.809479 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.809634 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.809792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.809946 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.810093 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.810239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.810391 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.810557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.810718 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.810872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.811017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.811168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.811321 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.811475 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.811628 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.811773 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.811936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.812086 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.812231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.812231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.812567 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.812713 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.812865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.813017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.813017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.813303 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.813626 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.813777 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.813929 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.813929 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.814220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.814455 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.814622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.814775 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.814947 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.815096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.815267 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.815541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.815720 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.816078 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.816247 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.816450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.816621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.816767 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.816920 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.817087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.817233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.817377 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.817535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.817689 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.817835 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.817987 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.818143 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.818288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.818450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.818604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.818751 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.818894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.819056 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.819201 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.819354 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.819507 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.819652 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.819798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.819798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.820097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.820097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.820413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.820766 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.820915 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.821058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.821227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.822168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.822349 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.822507 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.822664 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.822819 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.822965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.823108 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.823261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.823416 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.823570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.823889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.824494 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.824671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.824833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.824996 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.825178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.825389 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.825678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.825846 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.826026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.826441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.826611 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.826802 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.826966 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.827140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.827308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.827488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.827669 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.827831 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.827992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.828210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.828443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.828636 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.828860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.829029 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.829192 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.829345 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.829577 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.829744 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.830125 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.830292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.830474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.830635 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.830976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.831135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.831135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.831514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.831682 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.831862 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.832016 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.832182 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.832353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.832512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.832674 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.832836 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.832995 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 13:43:52.833156 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.833309 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.833468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.833627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.833792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.834097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.834258 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.834436 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.834599 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.834751 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.834914 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.835074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.835234 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.835399 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.835560 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.835838 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.836000 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.836152 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.836152 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.836680 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.836833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.836993 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.837146 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.837304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.837456 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.837616 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.837768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.837941 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.838093 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.838244 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.838394 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.838553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.838724 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.838884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.839035 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.839185 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.839344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.839509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.839671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.839831 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.840552 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.840716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.840945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.841119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.841284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.841437 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.841588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.841740 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.841902 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.842056 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.842214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.842371 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.842529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.842690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.842850 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.843002 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.843153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.843322 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.843484 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.843650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.843812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.843965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.844133 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.844494 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.844655 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.844820 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.844983 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.845136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.845295 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.845447 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.845609 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.845773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.845957 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.845957 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.846263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.846263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.846740 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.846910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.847065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.847065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.847065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.847065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.847651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.847823 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.847984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.848175 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.848350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.848509 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.848674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.848827 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.848986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.849145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.849297 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.849447 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.849607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.849778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.849931 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.850082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.850244 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.850404 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.850563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.850723 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.850874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.851024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.851024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.851340 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.851501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.851652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.851813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.851976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.851976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.852284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.852284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.852607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.852757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.852920 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.853071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.853236 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.853388 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.853537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.853688 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.853853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.854014 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.854166 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.854325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.854496 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.854757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.854923 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.855089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.855242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.855242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.855566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.856259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.856544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.856826 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.856987 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.857140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.857298 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.857460 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.857612 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.857780 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.857947 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.858099 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.858264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.858264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.858561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.858561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.858870 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.859022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.859180 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.859332 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.859490 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.859650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.859802 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.859952 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.860103 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.860293 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.860483 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.860645 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.860820 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.860974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.861124 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.861284 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.861448 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.861609 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.861761 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.861921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.862072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.862245 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.862402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.862562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.862722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.862888 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.863040 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.863209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.863369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.863521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.863679 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.863832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.863989 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.864150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.864361 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.864521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.864683 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.864965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.865138 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.865300 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.865461 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.865613 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.865772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.865967 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.866135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.866289 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.866439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.866590 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.866748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.866924 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.867090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.867260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.867431 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.867597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.867756 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.867918 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.868084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.868244 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.868423 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.868588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.868751 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.868912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.869066 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.869228 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.869388 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.869540 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.869698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.869859 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.870012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.870172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.870324 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.870474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.870632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.870797 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.870957 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.871136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.871306 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.871460 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.871610 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.871770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.871929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.871929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.872235 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.872527 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.872735 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.872918 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.873072 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.873230 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.873382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.873544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.873708 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.873861 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.874011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.874172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.874325 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.874502 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.874623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.874767 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.874876 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.874966 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.875084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.875243 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.875412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.875573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.875722 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.875892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876104 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876298 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876523 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876622 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.876991 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877275 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877370 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877623 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877897 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.877997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.878110 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.878199 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.878283 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.878367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.878460 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.878627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.878757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.878890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879174 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879726 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879813 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879906 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.879999 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880169 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880309 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880309 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880466 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880750 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880848 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.880934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881213 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881311 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881397 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881571 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881656 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881739 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881835 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.881920 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882004 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882177 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882449 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882793 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.882958 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883046 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883307 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883405 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883500 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883684 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883869 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.883968 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884055 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884139 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884222 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884420 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884513 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884676 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884756 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884835 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884906 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.884989 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.885071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.885071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.885198 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.885285 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.885372 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.885503 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.885622 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.886127 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.886294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.886450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.886630 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.886863 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.887116 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.887294 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.887459 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.887621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.887800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.887800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.888101 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.888254 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.888437 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.888601 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.888768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.888921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.889072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.889236 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.889417 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.889585 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.889757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.889917 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.890071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.890223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.890382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.890588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.890744 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.890896 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.891058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.891058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.891347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.891347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.891654 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.891819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.891978 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.892131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.892283 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.892514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.892667 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.892819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.892970 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.893130 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.893296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.893458 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.893619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.893772 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.893941 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.894101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.894101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.894407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.894567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.894733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.894895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.895047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.895199 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.895376 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.895642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.895809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.895973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.896125 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.896286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.896463 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.896463 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.896776 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.896928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.897088 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.897252 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.897406 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.897557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.897717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.897869 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.898038 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.898198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.898351 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.898510 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.898676 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.898836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.898988 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.899147 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.899308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.899470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.899623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.899784 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.899945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.900108 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.900267 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.900475 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.900629 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.900781 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.900933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.901085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.901236 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.901402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.901556 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.901707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.901858 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.902009 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.902170 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.902331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.903012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.903221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.903406 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.903593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.903817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.903972 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.904131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.904291 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.904471 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.904624 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.904799 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.904961 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.905115 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.905266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.905425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.905585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.905865 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.906035 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.906189 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.906340 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.906492 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.906650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.906813 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.906984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.907141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.907293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.907444 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.907604 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.907758 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.907916 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.908069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.908229 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.908433 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.908603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.908770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.908932 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.909097 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.909249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.909408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.909575 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.909730 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.909883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.910042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.910201 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.910361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.910601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.910756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.910917 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.911069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.911243 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.911410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.911562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.911715 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.911866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.912026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.912186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.912375 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.912536 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.912688 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.912840 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.912840 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.913150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.913311 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.913464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.913622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.913775 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.913925 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.914078 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.914242 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.914402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.914555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.914714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.914865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.915025 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.915199 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.915352 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.915503 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.915654 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.915803 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.916109 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.916273 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.916449 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.916620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.916620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.916911 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.917085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.917248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.917420 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.917582 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.917749 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.917911 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.918145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.918805 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.918966 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.919127 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.919289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.919443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.919603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.919755 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.919928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.920081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.920246 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.920477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.920633 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.920785 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.920938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.921114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.921269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.921421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.921573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.921725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.921877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.922049 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.922203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.922364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.922525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.922678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.922830 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.922995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.923148 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.923300 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.923460 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.923614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.923781 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.923945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.924096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.924256 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.924432 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.924598 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.924761 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.924914 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.925066 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.925800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.925957 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.926143 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.926418 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.926418 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.926728 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.926891 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.927064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.927228 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.927381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.927531 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.927684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.927844 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.928006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.928167 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.928339 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.928521 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.928683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.928845 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.929007 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.929168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.929322 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.929474 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.929627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.929779 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.929938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.930090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.930250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.930409 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.930586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.930748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.930748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.931055 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.931216 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.931376 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.931529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.931692 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.931877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.932031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.932182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.932369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.932529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.932705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.932858 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.933011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.933171 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.933324 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.933484 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.933765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.933927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.934081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.934233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.934413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.934634 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.934801 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.934954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.935106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.935256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.935408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.935574 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.935741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.935895 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.936055 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.936214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.936434 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.936727 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.936895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.937080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.937080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.937382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.937542 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.937704 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.937865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.938018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.938178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.938331 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.938498 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.938659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.938812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.938970 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.939136 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.939297 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.939464 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.939624 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.939784 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.939945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.940097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.940250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.940250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.940574 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.940651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.940840 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.940984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.941146 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.941300 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.941493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.941493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.941766 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.941917 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.942076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.942216 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.942366 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.942366 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.942632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.942770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.942881 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.942881 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.943151 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.943292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.943436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.943584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.943734 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.943882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944171 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944337 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944337 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944885 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.944983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945154 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945238 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945322 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945406 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945504 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945692 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945787 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945882 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.945975 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946239 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946321 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946787 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.946965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947154 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947238 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947329 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947792 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.947961 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948152 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948226 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948356 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948356 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948821 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.948916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.949315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.949468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.949631 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.949757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.949855 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.949950 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.950024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.950103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.950256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.950403 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.950566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.950673 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.950890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.950995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.951214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.951325 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.951508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.951651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.951884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.952107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.952282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.952480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.952633 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.952785 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.952938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.953101 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.953255 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.953406 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.953570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.953736 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.953898 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.954064 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.954225 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.954378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.954529 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.954682 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.954843 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.955007 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.955159 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.955318 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.955469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.955632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.955793 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.955945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.956097 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.956258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.956505 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.956659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.956827 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.956989 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.957142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.957294 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.957446 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.957616 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.957779 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.957939 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.958108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.958265 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.958417 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.958569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.958731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.958894 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.959047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.959047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.959353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.959353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.959743 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.959895 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.960046 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.960198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.960410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.960587 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.960741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.960899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.961052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.961212 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.961391 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.961583 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.961773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.961931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.962091 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.962243 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.962404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.962556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.962708 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.962868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.963021 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.963173 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.963334 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.963487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.963646 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.963809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.963989 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.964144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.964329 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.964535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.964697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.965388 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.965553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.965713 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.965877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.966038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.966190 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.966342 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.966342 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.966666 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.966819 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.966970 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.967128 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.967281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.967432 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.967594 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.967755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.967908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.968065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.968221 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.968406 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.968579 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.968733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.968892 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.969043 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.969203 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.969203 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.969499 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.969653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.969805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.969964 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.970116 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.970280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.970443 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.970596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.970756 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.970916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.971068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.971228 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.971381 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.971542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.971702 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.971856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.972021 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.972183 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.972414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.972599 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.972760 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.972912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.972912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.973223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.973384 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.973558 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.973723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.973877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.973877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.974174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.974174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.974461 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.974623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.974783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.974953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.975105 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.975257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.975407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.975559 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.975718 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.975718 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.976026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.976178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.976350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.976521 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.976692 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.976845 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.977006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.977006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.977310 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.977471 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.977632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.977792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.977952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.978117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.978269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.978431 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.978596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.978757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.978909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.979069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.979221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.979390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.979556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.979718 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.979870 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.980030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.980192 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.980406 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.981135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.981305 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.981466 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.981627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.981790 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.981957 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.982118 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.982118 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.982408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.982559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.982719 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.982879 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.982879 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.983180 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.983332 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.983483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.983643 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.983796 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.983955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.984114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.984265 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.984453 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.984618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.984618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.984942 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.985095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.985095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.985397 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.985397 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.985694 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.985846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.985998 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.986149 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.986310 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.986464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.986622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.986785 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.986944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.987096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.987257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.987410 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.987562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.987713 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.987865 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.988025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.988197 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.988427 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.988599 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.988753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.988925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:43:52.989092 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.989092 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.989423 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.989762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.990071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.990395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.990709 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.991251 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.991606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.991927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.992256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.992610 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.992930 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.993239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.993566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.993873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.994181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.994500 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.994813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.995127 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.995434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.995748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.996058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.996552 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.996875 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.997186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.997518 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.997828 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.998136 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.998444 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.998760 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.999066 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.999413 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:52.999723 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.000033 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.000371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.000685 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.000997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.001305 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.001621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.001927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.002245 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.002688 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.002933 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.003245 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.003555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.003883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.004198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.004552 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.004874 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.005188 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.005954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.005954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.006422 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.006759 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.007421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.007421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.007763 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.008057 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.008365 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.008679 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.009006 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.009306 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.009624 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.009983 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.010402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.010681 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.011017 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.011373 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.011814 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.012140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.012485 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.012876 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.013249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.013569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.013893 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.014240 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.014567 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.014898 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.015219 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.015540 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.015854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.016167 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.016508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.016827 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.017149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.017483 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.017803 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.018111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.018545 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.018917 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.019243 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.019568 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.019882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.020206 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.020561 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.020876 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.021200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.021516 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.021847 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.022193 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.022525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.022918 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.023157 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.023465 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.023771 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.024084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.024453 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.024776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.025083 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.025393 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.025707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.026015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.026324 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.026633 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.026940 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.027252 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.028236 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.028665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.029022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.029296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.029606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.029915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.030230 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.030541 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.030851 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.031158 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.031469 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.031776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.032112 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.032475 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.032799 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.033131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.033447 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.033772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.034085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.034411 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.034741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.035069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.035382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.035718 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.036032 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.036376 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.036690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.037003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.037315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.037630 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.037957 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.038287 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.038598 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.038921 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.039242 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.039567 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.039887 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.040201 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.040557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.040872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.041187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.041508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.041823 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.042183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.042467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.042775 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.043685 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.044022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.044347 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.044718 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.045051 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.045407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.045724 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.046073 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.046404 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.046723 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.047038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.047347 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 13:43:53.047593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 13:43:53.049312 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO dbcounter [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Registered counter for database nova_api May 26 13:43:53.071351 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_db.sqlalchemy.engines [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:43:53.080504 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writer thread running {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:43:53.108672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO dbcounter [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Registered counter for database nova_api May 26 13:43:53.129386 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_db.sqlalchemy.engines [None req-709a5382-def2-489b-b5d6-19456555d69b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:43:53.137920 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writer thread running {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:43:53.143155 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.context [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11d24607-eb88-459e-b6ca-9c71caaa8fb1(cell1) {{(pid=124241) load_cells /opt/stack/nova/nova/context.py:464}} May 26 13:43:53.147516 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:43:53.149147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:43:53.149971 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:43:53.151977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:43:53.154587 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO dbcounter [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Registered counter for database nova_cell0 May 26 13:43:53.158805 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO dbcounter [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Registered counter for database nova_cell1 May 26 13:43:53.166756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_db.sqlalchemy.engines [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:43:53.169062 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_db.sqlalchemy.engines [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:43:53.175325 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writer thread running {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:43:53.176945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writer thread running {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:43:53.196709 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.context [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),11d24607-eb88-459e-b6ca-9c71caaa8fb1(cell1) {{(pid=124240) load_cells /opt/stack/nova/nova/context.py:464}} May 26 13:43:53.202156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:43:53.203745 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:43:53.204582 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:43:53.206581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:43:53.208662 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO dbcounter [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Registered counter for database nova_cell0 May 26 13:43:53.213257 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO dbcounter [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Registered counter for database nova_cell1 May 26 13:43:53.222078 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_db.sqlalchemy.engines [None req-709a5382-def2-489b-b5d6-19456555d69b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:43:53.222563 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_db.sqlalchemy.engines [None req-709a5382-def2-489b-b5d6-19456555d69b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:43:53.229172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writer thread running {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:43:53.230736 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writer thread running {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:43:53.331515 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO dbcounter [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Registered counter for database nova_cell0 May 26 13:43:53.339756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_db.sqlalchemy.engines [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:43:53.347700 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writer thread running {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:43:53.393400 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO dbcounter [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Registered counter for database nova_cell0 May 26 13:43:53.404365 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_db.sqlalchemy.engines [None req-709a5382-def2-489b-b5d6-19456555d69b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 13:43:53.409588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writer thread running {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 13:43:53.689805 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: WARNING keystonemiddleware.auth_token [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:43:53.697702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: WARNING keystonemiddleware.auth_token [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:43:53.738753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: WARNING keystonemiddleware.auth_token [None req-709a5382-def2-489b-b5d6-19456555d69b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:43:53.746772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: WARNING keystonemiddleware.auth_token [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:43:54.062951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: WARNING keystonemiddleware.auth_token [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:43:54.069042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: WARNING keystonemiddleware.auth_token [None req-1f880217-4625-4ad2-9c1a-330f7141f07e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:43:54.074656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fde29669c0 pid: 124241 (default app) May 26 13:43:54.094579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: WARNING keystonemiddleware.auth_token [None req-709a5382-def2-489b-b5d6-19456555d69b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 13:43:54.100617 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: WARNING keystonemiddleware.auth_token [None req-709a5382-def2-489b-b5d6-19456555d69b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 13:43:54.106415 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fde29669c0 pid: 124240 (default app) May 26 13:44:37.571450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:37.575876 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:37.577894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:37.580491 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:39.347581 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b1d35eea-7251-4f43-8208-f731a3298da2 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Action: 'create', calling method: .version_select at 0x7f07e24b8ca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1172229954", "metadata": {"Type": "work"}}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b1d35eea-7251-4f43-8208-f731a3298da2 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Request method failure captured: May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 122 May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RF6ZPJsdxnAWGi6Jsj9XOmo2BcZOeQ_9IFIPmkk0AF0zsKqPRfhSG_YR5k7EBrru32WfmfqZ3SO_YWMsRGfCDN2TAY-uH8YM8FMqTiWDtut9M6sKxOZrCkflGkXJBhGdUZEJEEX6zmmsysRK95mD8x5hiCsSLovi1RQTe-w2Y_jww May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:44:39.372472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87a88010e32e4f3297249813b5896ec8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesNegativeTest-30020593-project May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: c6ac1b362e014cf794564203566956e2 May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesNegativeTest-30020593-project May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1172229954", "metadata": {"Type": "work"}}} May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: May 26 13:44:39.374045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1172229954', 'metadata': {'Type': 'work'}}}} May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise error May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi '#$%' May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:44:39.374976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 13:44:39.376338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 13:44:39.379678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 13:44:39.379678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.379678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b1d35eea-7251-4f43-8208-f731a3298da2 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:44:39.379678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b1d35eea-7251-4f43-8208-f731a3298da2 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.835197 May 26 13:44:39.379678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1155 bytes} [Thu May 26 13:44:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1837 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 13:44:39.394556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:39.397172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:39.399365 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:39.403596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:39.814826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f92a7273-0d91-4cd6-941d-d8be05f3155c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Action: 'create', calling method: .version_select at 0x7f07e2488820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1361056193", "metadata": {"Type": "work"}}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f92a7273-0d91-4cd6-941d-d8be05f3155c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Request method failure captured: May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 120 May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RF6ZPJsdxnAWGi6Jsj9XOmo2BcZOeQ_9IFIPmkk0AF0zsKqPRfhSG_YR5k7EBrru32WfmfqZ3SO_YWMsRGfCDN2TAY-uH8YM8FMqTiWDtut9M6sKxOZrCkflGkXJBhGdUZEJEEX6zmmsysRK95mD8x5hiCsSLovi1RQTe-w2Y_jww May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:44:39.825501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87a88010e32e4f3297249813b5896ec8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-VolumesNegativeTest-30020593-project May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: c6ac1b362e014cf794564203566956e2 May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-VolumesNegativeTest-30020593-project May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1361056193", "metadata": {"Type": "work"}}} May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: May 26 13:44:39.827179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1361056193', 'metadata': {'Type': 'work'}}}} May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise error May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi '0' May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:44:39.828200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 13:44:39.829907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 13:44:39.831262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 13:44:39.831262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:39.837183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f92a7273-0d91-4cd6-941d-d8be05f3155c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:44:39.839353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f92a7273-0d91-4cd6-941d-d8be05f3155c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.451290 May 26 13:44:39.842812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1155 bytes} [Thu May 26 13:44:39 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 456 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 13:44:39.861538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0e141e68-2079-4df0-be96-498ba100254e tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Action: 'create', calling method: .version_select at 0x7f07e239ff70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-536850966", "metadata": {"Type": "work"}}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0e141e68-2079-4df0-be96-498ba100254e tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Request method failure captured: May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 118 May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RF6ZPJsdxnAWGi6Jsj9XOmo2BcZOeQ_9IFIPmkk0AF0zsKqPRfhSG_YR5k7EBrru32WfmfqZ3SO_YWMsRGfCDN2TAY-uH8YM8FMqTiWDtut9M6sKxOZrCkflGkXJBhGdUZEJEEX6zmmsysRK95mD8x5hiCsSLovi1RQTe-w2Y_jww May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:44:39.867604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87a88010e32e4f3297249813b5896ec8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesNegativeTest-30020593-project May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: c6ac1b362e014cf794564203566956e2 May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesNegativeTest-30020593-project May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-536850966", "metadata": {"Type": "work"}}} May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: May 26 13:44:39.869400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-536850966', 'metadata': {'Type': 'work'}}}} May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise error May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi '' May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:44:39.870356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 13:44:39.871894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 13:44:39.873430 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 13:44:39.873430 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:44:39.873430 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0e141e68-2079-4df0-be96-498ba100254e tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:44:39.873430 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0e141e68-2079-4df0-be96-498ba100254e tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017194 May 26 13:44:39.873430 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 2/3] 10.222.0.16 () {60 vars in 1155 bytes} [Thu May 26 13:44:39 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 13:44:39.894785 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0d73445a-4bb1-4a38-b900-8367d3b0c945 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Calling method '.version_select at 0x7f07e2c9d310>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:40.828681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-997052776", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "networks": [{"uuid": "fe7c5613-fb2c-42f9-ab8b-0d2c594276aa"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:44:41.497917 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] validate_networks() for [('fe7c5613-fb2c-42f9-ab8b-0d2c594276aa', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:44:41.733975 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-0d73445a-4bb1-4a38-b900-8367d3b0c945 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] HTTP exception thrown: Volume tempest-invalid-1601243803 could not be found. May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0d73445a-4bb1-4a38-b900-8367d3b0c945 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Request method failure captured: May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1601243803 HTTP/1.1 May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RF6ZPJsdxnAWGi6Jsj9XOmo2BcZOeQ_9IFIPmkk0AF0zsKqPRfhSG_YR5k7EBrru32WfmfqZ3SO_YWMsRGfCDN2TAY-uH8YM8FMqTiWDtut9M6sKxOZrCkflGkXJBhGdUZEJEEX6zmmsysRK95mD8x5hiCsSLovi1RQTe-w2Y_jww May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:44:41.738488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87a88010e32e4f3297249813b5896ec8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-VolumesNegativeTest-30020593 May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-VolumesNegativeTest-30020593-project May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: c6ac1b362e014cf794564203566956e2 May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-VolumesNegativeTest-30020593-project May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Volume tempest-invalid-1601243803 could not be found. May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'tempest-invalid-1601243803'} May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:44:41.739698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1601243803 could not be found. (HTTP 404) (Request-ID: req-f1d8657c-2a9f-4398-853c-043b2fabab5d) May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:41.740628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:44:41.775367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1601243803 could not be found. May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:44:41.782659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1601243803 could not be found. May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1601243803 could not be found. May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0d73445a-4bb1-4a38-b900-8367d3b0c945 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Returning 404 to user: Volume tempest-invalid-1601243803 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0d73445a-4bb1-4a38-b900-8367d3b0c945 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1601243803" status: 404 len: 99 microversion: 2.1 time: 1.860675 May 26 13:44:41.787706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1217 bytes} [Thu May 26 13:44:39 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1601243803 => generated 99 bytes in 1864 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 13:44:41.790358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fb30222c-7117-4d98-955b-67bf1d6da09b tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.028344 May 26 13:44:41.790358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1139 bytes} [Thu May 26 13:44:41 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 13:44:41.805758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-128a0886-aaca-472a-85d9-bfbc87cbbcac tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010551 May 26 13:44:41.810010 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 4/6] 10.222.0.16 () {58 vars in 1136 bytes} [Thu May 26 13:44:41 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 13:44:41.837922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-580664e9-77bd-497b-a1bc-dfd4dc554a7c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Calling method '.version_select at 0x7f07e2292a60>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:42.231588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-580664e9-77bd-497b-a1bc-dfd4dc554a7c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] HTTP exception thrown: Volume 58dded93-a468-4818-8707-0d2e54ca656c could not be found. May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-580664e9-77bd-497b-a1bc-dfd4dc554a7c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Request method failure captured: May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: DELETE /compute/v2.1/os-volumes/58dded93-a468-4818-8707-0d2e54ca656c HTTP/1.1 May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RF6ZPJsdxnAWGi6Jsj9XOmo2BcZOeQ_9IFIPmkk0AF0zsKqPRfhSG_YR5k7EBrru32WfmfqZ3SO_YWMsRGfCDN2TAY-uH8YM8FMqTiWDtut9M6sKxOZrCkflGkXJBhGdUZEJEEX6zmmsysRK95mD8x5hiCsSLovi1RQTe-w2Y_jww May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:44:42.233569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87a88010e32e4f3297249813b5896ec8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-VolumesNegativeTest-30020593 May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-VolumesNegativeTest-30020593-project May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: c6ac1b362e014cf794564203566956e2 May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-VolumesNegativeTest-30020593-project May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Volume 58dded93-a468-4818-8707-0d2e54ca656c could not be found. May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '58dded93-a468-4818-8707-0d2e54ca656c'} May 26 13:44:42.234722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 58dded93-a468-4818-8707-0d2e54ca656c could not be found. (HTTP 404) (Request-ID: req-41d3cfd3-b5d8-4d53-9b4b-1b7cf8b171b1) May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:42.235439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:44:42.236492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 58dded93-a468-4818-8707-0d2e54ca656c could not be found. May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 13:44:42.238063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 58dded93-a468-4818-8707-0d2e54ca656c could not be found. May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 58dded93-a468-4818-8707-0d2e54ca656c could not be found. May 26 13:44:42.240207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.243165 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-580664e9-77bd-497b-a1bc-dfd4dc554a7c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Returning 404 to user: Volume 58dded93-a468-4818-8707-0d2e54ca656c could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:44:42.245461 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-580664e9-77bd-497b-a1bc-dfd4dc554a7c tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/58dded93-a468-4818-8707-0d2e54ca656c" status: 404 len: 109 microversion: 2.1 time: 0.426629 May 26 13:44:42.246185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 5/7] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:44:41 2022] DELETE /compute/v2.1/os-volumes/58dded93-a468-4818-8707-0d2e54ca656c => generated 109 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:44:42.269980 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-54679a1f-859c-4ea7-9501-8c928d2481b7 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Calling method '.version_select at 0x7f07e2292310>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:42.506357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-54679a1f-859c-4ea7-9501-8c928d2481b7 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] HTTP exception thrown: Volume 91866071-7808-478f-8dab-adf911ac51ae could not be found. May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-54679a1f-859c-4ea7-9501-8c928d2481b7 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Request method failure captured: May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/os-volumes/91866071-7808-478f-8dab-adf911ac51ae HTTP/1.1 May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RF6ZPJsdxnAWGi6Jsj9XOmo2BcZOeQ_9IFIPmkk0AF0zsKqPRfhSG_YR5k7EBrru32WfmfqZ3SO_YWMsRGfCDN2TAY-uH8YM8FMqTiWDtut9M6sKxOZrCkflGkXJBhGdUZEJEEX6zmmsysRK95mD8x5hiCsSLovi1RQTe-w2Y_jww May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:44:42.508926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_87a88010e32e4f3297249813b5896ec8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/87a88010e32e4f3297249813b5896ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-VolumesNegativeTest-30020593 May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 87a88010e32e4f3297249813b5896ec8 May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-VolumesNegativeTest-30020593 May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-VolumesNegativeTest-30020593-project May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: c6ac1b362e014cf794564203566956e2 May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-VolumesNegativeTest-30020593-project May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Volume 91866071-7808-478f-8dab-adf911ac51ae could not be found. May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '91866071-7808-478f-8dab-adf911ac51ae'} May 26 13:44:42.510798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91866071-7808-478f-8dab-adf911ac51ae could not be found. (HTTP 404) (Request-ID: req-88f0876d-fddd-4a0c-9686-79479a11db9c) May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:42.511584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:44:42.512801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91866071-7808-478f-8dab-adf911ac51ae could not be found. May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 13:44:42.514689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91866071-7808-478f-8dab-adf911ac51ae could not be found. May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91866071-7808-478f-8dab-adf911ac51ae could not be found. May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-54679a1f-859c-4ea7-9501-8c928d2481b7 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] Returning 404 to user: Volume 91866071-7808-478f-8dab-adf911ac51ae could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-54679a1f-859c-4ea7-9501-8c928d2481b7 tempest-VolumesNegativeTest-30020593 tempest-VolumesNegativeTest-30020593-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/91866071-7808-478f-8dab-adf911ac51ae" status: 404 len: 109 microversion: 2.1 time: 0.260088 May 26 13:44:42.519187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 6/8] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:44:42 2022] GET /compute/v2.1/os-volumes/91866071-7808-478f-8dab-adf911ac51ae => generated 109 bytes in 262 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:44:43.381173 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3c46e0ca-ccf5-413d-b439-ddd11307b225 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'create', calling method: .version_select at 0x7f07e22929d0>, body: {"keypair": {"name": "tempest-keypair-508599193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPnSWVRY5T77pbQGMQFP7UM7YKoOgiwlZqjnnaprM5efExW4n2lKsmvOKVCxLqhCmh85Gsf5YRjud1xHFkUqTRjQixRY90M9QWu0ohZfkuY2ALIzowPGg1qRhHNHyFlhg=="}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:44:43.524607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-3c46e0ca-ccf5-413d-b439-ddd11307b225 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Getting quotas for project 1ce476b2a1764f56b9780f4a5c75ac3d. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:44:43.543016 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-3c46e0ca-ccf5-413d-b439-ddd11307b225 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Getting quotas for user e13f5cad16824554a1fb32ed9a915ae9 and project 1ce476b2a1764f56b9780f4a5c75ac3d. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:44:43.656297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3c46e0ca-ccf5-413d-b439-ddd11307b225 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.699078 May 26 13:44:43.659254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 7/9] 10.222.0.16 () {62 vars in 1199 bytes} [Thu May 26 13:44:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 703 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 26 13:44:44.914843 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:44:44.915295 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:44:44.916064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:44:44.916747 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:44:44.917458 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:44:44.951120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:44.955937 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:44.958233 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:44.959443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:45.049507 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Getting quotas for project 7a22ae4c671d4c828ea95651dd7ec9cd. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:44:45.059759 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Getting quotas for user f43bfa3b0a2a4fa28ef2e80295fed484 and project 7a22ae4c671d4c828ea95651dd7ec9cd. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:44:45.093969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:44:45.099001 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:44:45.311428 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cceee8e8-b515-466f-b756-c8dcddeddd23 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.905619 May 26 13:44:45.312354 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 3/10] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 4907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:44:45.327979 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-52261fef-7b6e-4bd5-9b37-71e667bedced tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:45.331067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-52261fef-7b6e-4bd5-9b37-71e667bedced tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:45.568949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-52261fef-7b6e-4bd5-9b37-71e667bedced tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:45.599257 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-52261fef-7b6e-4bd5-9b37-71e667bedced tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1214 microversion: 2.1 time: 0.279884 May 26 13:44:45.602074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 8/11] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:45 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1214 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:46.620008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3f7f490a-8b5c-4373-8071-b3c3a7f41df7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:46.620673 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3f7f490a-8b5c-4373-8071-b3c3a7f41df7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:46.805928 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3f7f490a-8b5c-4373-8071-b3c3a7f41df7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:46.831601 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3f7f490a-8b5c-4373-8071-b3c3a7f41df7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1214 microversion: 2.1 time: 0.215904 May 26 13:44:46.832781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 4/12] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:46 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1214 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:47.852271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2d981b5f-e053-43bb-bceb-9b86b30cb8e3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:47.854148 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2d981b5f-e053-43bb-bceb-9b86b30cb8e3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:47.877147 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2d981b5f-e053-43bb-bceb-9b86b30cb8e3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:47.877883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2d981b5f-e053-43bb-bceb-9b86b30cb8e3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:47.878685 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2d981b5f-e053-43bb-bceb-9b86b30cb8e3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:47.879312 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2d981b5f-e053-43bb-bceb-9b86b30cb8e3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:48.180186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2d981b5f-e053-43bb-bceb-9b86b30cb8e3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:48.216889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2d981b5f-e053-43bb-bceb-9b86b30cb8e3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1218 microversion: 2.1 time: 0.370712 May 26 13:44:48.219306 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 9/13] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:47 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1218 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:49.238939 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ec5363df-68c1-48d9-9629-3e420186fce7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:49.239566 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ec5363df-68c1-48d9-9629-3e420186fce7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:49.270701 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec5363df-68c1-48d9-9629-3e420186fce7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:49.279982 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec5363df-68c1-48d9-9629-3e420186fce7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:49.281699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec5363df-68c1-48d9-9629-3e420186fce7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:49.282469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec5363df-68c1-48d9-9629-3e420186fce7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:49.686721 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ec5363df-68c1-48d9-9629-3e420186fce7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:49.710180 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ec5363df-68c1-48d9-9629-3e420186fce7 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1218 microversion: 2.1 time: 0.478243 May 26 13:44:49.713961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 5/14] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:49 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1218 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:50.732485 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f6a96135-8689-4227-bbcb-767178c7e898 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:50.748501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f6a96135-8689-4227-bbcb-767178c7e898 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:50.758711 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6a96135-8689-4227-bbcb-767178c7e898 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:50.759690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6a96135-8689-4227-bbcb-767178c7e898 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:50.760803 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6a96135-8689-4227-bbcb-767178c7e898 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:50.761379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6a96135-8689-4227-bbcb-767178c7e898 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:51.395992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f6a96135-8689-4227-bbcb-767178c7e898 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:51.407297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f6a96135-8689-4227-bbcb-767178c7e898 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1218 microversion: 2.1 time: 0.682763 May 26 13:44:51.412981 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 10/15] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:50 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1218 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:52.105630 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1761249194", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7243f764-410e-4885-acdc-a415825d1293"}], "security_groups": [{"name": "tempest-securitygroup--1279042641"}], "key_name": "tempest-keypair-508599193", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:44:52.425680 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1f53d876-2f75-4259-9830-32dbef056f9f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:52.426541 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1f53d876-2f75-4259-9830-32dbef056f9f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:52.436452 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f53d876-2f75-4259-9830-32dbef056f9f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:52.437258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f53d876-2f75-4259-9830-32dbef056f9f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:52.438794 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f53d876-2f75-4259-9830-32dbef056f9f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:52.447355 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f53d876-2f75-4259-9830-32dbef056f9f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:52.511417 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] validate_networks() for [('7243f764-410e-4885-acdc-a415825d1293', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:44:52.612035 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1f53d876-2f75-4259-9830-32dbef056f9f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:52.624232 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1f53d876-2f75-4259-9830-32dbef056f9f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1266 microversion: 2.1 time: 0.202212 May 26 13:44:52.634411 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 11/16] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:52 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:53.643682 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e9e91af5-a7d0-4c4a-b677-b55c9c21abf3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:53.644472 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e9e91af5-a7d0-4c4a-b677-b55c9c21abf3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:53.661256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9e91af5-a7d0-4c4a-b677-b55c9c21abf3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:53.661709 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9e91af5-a7d0-4c4a-b677-b55c9c21abf3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:53.665949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9e91af5-a7d0-4c4a-b677-b55c9c21abf3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:53.666226 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9e91af5-a7d0-4c4a-b677-b55c9c21abf3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:53.785060 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e9e91af5-a7d0-4c4a-b677-b55c9c21abf3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:53.795816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e9e91af5-a7d0-4c4a-b677-b55c9c21abf3 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1266 microversion: 2.1 time: 0.157571 May 26 13:44:53.810027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 12/17] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:53 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:54.689398 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:44:54.691784 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:44:54.693486 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:44:54.694231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:44:54.694883 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:44:54.723226 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:54.723860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:54.725121 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:54.726660 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:54.784879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Getting quotas for project 1ce476b2a1764f56b9780f4a5c75ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:44:54.792033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Getting quotas for user e13f5cad16824554a1fb32ed9a915ae9 and project 1ce476b2a1764f56b9780f4a5c75ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:44:54.818047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-43ff92a1-7897-4c8b-9506-aa1ae78bf36e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:54.819827 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-43ff92a1-7897-4c8b-9506-aa1ae78bf36e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:54.828274 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-43ff92a1-7897-4c8b-9506-aa1ae78bf36e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:54.829596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-43ff92a1-7897-4c8b-9506-aa1ae78bf36e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:54.830262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-43ff92a1-7897-4c8b-9506-aa1ae78bf36e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:54.831045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-43ff92a1-7897-4c8b-9506-aa1ae78bf36e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:54.846207 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:44:54.850543 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:44:54.981602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-53a4bb9d-d4a5-44f1-8b1e-b072a31688d3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.884114 May 26 13:44:54.988812 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 6/18] 10.222.0.16 () {62 vars in 1187 bytes} [Thu May 26 13:44:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 13:44:54.990142 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-43ff92a1-7897-4c8b-9506-aa1ae78bf36e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:55.004915 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf6d7ffd-f186-4d23-8f35-fc4f0904947b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:55.005699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf6d7ffd-f186-4d23-8f35-fc4f0904947b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:55.008273 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-43ff92a1-7897-4c8b-9506-aa1ae78bf36e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1274 microversion: 2.1 time: 0.192567 May 26 13:44:55.018746 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 13/19] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:54 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1274 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:44:55.209926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bf6d7ffd-f186-4d23-8f35-fc4f0904947b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:55.223862 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bf6d7ffd-f186-4d23-8f35-fc4f0904947b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:55.244969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bf6d7ffd-f186-4d23-8f35-fc4f0904947b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:55.266564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf6d7ffd-f186-4d23-8f35-fc4f0904947b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1281 microversion: 2.20 time: 0.269372 May 26 13:44:55.270165 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 7/20] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:44:54 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:44:56.047972 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f612e2bc-6f70-4189-88aa-ab2f746d2660 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:56.048632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f612e2bc-6f70-4189-88aa-ab2f746d2660 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:56.099512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=6 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:56.110404 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f612e2bc-6f70-4189-88aa-ab2f746d2660 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:56.110945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f612e2bc-6f70-4189-88aa-ab2f746d2660 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:56.116922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f612e2bc-6f70-4189-88aa-ab2f746d2660 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:56.117413 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f612e2bc-6f70-4189-88aa-ab2f746d2660 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:56.291126 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2d12f14b-1559-4f85-8b1d-4adf3c0ebdaa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:56.292598 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2d12f14b-1559-4f85-8b1d-4adf3c0ebdaa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:56.637077 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2d12f14b-1559-4f85-8b1d-4adf3c0ebdaa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:56.699277 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2d12f14b-1559-4f85-8b1d-4adf3c0ebdaa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:56.716874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2d12f14b-1559-4f85-8b1d-4adf3c0ebdaa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:56.722784 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2d12f14b-1559-4f85-8b1d-4adf3c0ebdaa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1281 microversion: 2.20 time: 0.437605 May 26 13:44:56.742205 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 8/21] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:44:56 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1281 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:44:57.328551 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f612e2bc-6f70-4189-88aa-ab2f746d2660 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:57.346788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f612e2bc-6f70-4189-88aa-ab2f746d2660 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1272 microversion: 2.1 time: 1.316862 May 26 13:44:57.364653 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 14/22] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:56 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1272 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:57.748133 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:57.756206 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:57.770320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:57.777079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:57.778447 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:57.779092 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:58.214420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:58.234401 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:58.236561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:58.238286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7e854eff-886b-4b1c-8dd9-459d72f2fb26 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1333 microversion: 2.20 time: 0.494936 May 26 13:44:58.253503 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 9/23] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:44:57 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1333 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:44:58.371932 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9a4c9812-46b3-4dbf-95b5-265bef8368c2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:58.373437 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9a4c9812-46b3-4dbf-95b5-265bef8368c2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:58.387949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a4c9812-46b3-4dbf-95b5-265bef8368c2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:58.388446 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a4c9812-46b3-4dbf-95b5-265bef8368c2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:58.390703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a4c9812-46b3-4dbf-95b5-265bef8368c2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:58.392341 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a4c9812-46b3-4dbf-95b5-265bef8368c2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:58.962909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9a4c9812-46b3-4dbf-95b5-265bef8368c2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:58.990265 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9a4c9812-46b3-4dbf-95b5-265bef8368c2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.623035 May 26 13:44:58.997749 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 15/24] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:44:58 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:44:59.259077 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:44:59.261064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:44:59.274527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:59.275298 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:59.276838 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:44:59.278553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:44:59.476900 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:59.495987 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:59.498300 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:44:59.502059 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ce529111-7519-43b1-ab7f-553988b7b90c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1339 microversion: 2.20 time: 0.245390 May 26 13:44:59.504018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 10/25] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:44:59 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1339 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:00.017491 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a7cd62c7-3cf7-4a5b-b009-dba90fb3747f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:00.020070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a7cd62c7-3cf7-4a5b-b009-dba90fb3747f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:00.048443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7cd62c7-3cf7-4a5b-b009-dba90fb3747f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:00.051412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7cd62c7-3cf7-4a5b-b009-dba90fb3747f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:00.056404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7cd62c7-3cf7-4a5b-b009-dba90fb3747f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:00.057308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7cd62c7-3cf7-4a5b-b009-dba90fb3747f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:00.568784 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8168c16c-2a3b-4e17-90f0-1ab510e8a0b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'create', calling method: .version_select at 0x7f07e18c8b80>, body: {"keypair": {"name": "tempest-keypair-901620882", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJims8VATYzcvYrJ4a0iuIms78nPPnEShHpi4jTUPsMJP61aM3gBa99gMGcMdNTcSVONJGs+kPRbgyPuFR5Yt0NMXMwSkwLxNbppF2uO9Z08EueIPtkpcEOwXwfaVsWgzQ=="}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:00.608682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a7cd62c7-3cf7-4a5b-b009-dba90fb3747f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:00.632381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a7cd62c7-3cf7-4a5b-b009-dba90fb3747f tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.618622 May 26 13:45:00.635641 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 11/26] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:00 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:00.636384 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-8168c16c-2a3b-4e17-90f0-1ab510e8a0b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Getting quotas for project 2007395425194750a87edd6c0da44e66. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:45:00.690489 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-8168c16c-2a3b-4e17-90f0-1ab510e8a0b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Getting quotas for user 9958aaa8690c468da2acec47b2bb5f23 and project 2007395425194750a87edd6c0da44e66. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:45:00.811491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8168c16c-2a3b-4e17-90f0-1ab510e8a0b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.176137 May 26 13:45:00.817463 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 16/27] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:44:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:00.851024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:00.851652 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:00.885927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:00.892468 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:00.897518 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:00.901705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:01.507510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-51386882", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:01.671811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] validate_networks() for [('fcfdea38-f7ed-4182-bc5e-d5404ef24e0e', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:45:02.002715 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:02.020608 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:02.023482 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:02.027933 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c2f4a75d-918f-4c19-8338-efdad37c8458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1339 microversion: 2.20 time: 1.199859 May 26 13:45:02.030446 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 17/28] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:00 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1339 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:02.051395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d939e2a9-d78f-4088-adab-1b1f8ff38248 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:02.052290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d939e2a9-d78f-4088-adab-1b1f8ff38248 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:02.059851 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d939e2a9-d78f-4088-adab-1b1f8ff38248 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:02.060781 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d939e2a9-d78f-4088-adab-1b1f8ff38248 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:02.061843 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d939e2a9-d78f-4088-adab-1b1f8ff38248 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:02.062770 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d939e2a9-d78f-4088-adab-1b1f8ff38248 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:03.827095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d939e2a9-d78f-4088-adab-1b1f8ff38248 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:03.838315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d939e2a9-d78f-4088-adab-1b1f8ff38248 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 1.804739 May 26 13:45:03.865596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 18/29] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:02 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:03.885778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:03.886512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:03.925014 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:03.930002 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:03.931519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:03.947676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:04.744113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:45:04.744825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:45:04.745087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:45:04.745548 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:45:04.746314 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:45:04.767711 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:04.773360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:04.774827 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:04.777465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:04.778306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:04.853845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Getting quotas for project 667a2ccd9c9045879b4b87e156997161. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:45:04.874741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Getting quotas for user dd8055e46e6149d3897fb88af0b19d39 and project 667a2ccd9c9045879b4b87e156997161. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:45:04.934346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:45:04.938376 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:45:05.078545 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-756a1b7c-e086-405f-a377-d97a5b57b413 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.440185 May 26 13:45:05.079211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 12/30] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:45:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 4443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:45:05.098919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-addbe39b-5028-4e15-a796-98da87574fb1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:05.099548 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-addbe39b-5028-4e15-a796-98da87574fb1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:05.129830 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-addbe39b-5028-4e15-a796-98da87574fb1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:05.153514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-addbe39b-5028-4e15-a796-98da87574fb1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:05.159123 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-addbe39b-5028-4e15-a796-98da87574fb1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:05.168580 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-addbe39b-5028-4e15-a796-98da87574fb1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:05.391892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:05.411564 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:05.415827 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:05.419303 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bbee1712-94f4-4db8-a6b0-42319eec615e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 1.553321 May 26 13:45:05.422634 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 19/31] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:03 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:05.440616 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9e84f875-0f1d-4096-a611-41f6cc0ece09 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:05.441553 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9e84f875-0f1d-4096-a611-41f6cc0ece09 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:05.944011 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9e84f875-0f1d-4096-a611-41f6cc0ece09 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:05.955823 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9e84f875-0f1d-4096-a611-41f6cc0ece09 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1220 microversion: 2.1 time: 0.530235 May 26 13:45:05.956448 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 20/32] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:05 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1220 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:06.331403 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-6305250", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:06.420924 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-addbe39b-5028-4e15-a796-98da87574fb1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:06.434505 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-addbe39b-5028-4e15-a796-98da87574fb1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 1.354187 May 26 13:45:06.459516 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 13/33] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:05 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:06.479743 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:06.485443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:06.526832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:06.527469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:06.528394 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:06.528950 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:06.590541 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.network.neutron [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] validate_networks() for [('fcfdea38-f7ed-4182-bc5e-d5404ef24e0e', None, None, None, None, None)] {{(pid=124240) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:45:07.455708 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:07.475746 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:07.483335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:07.488144 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9ed75501-08ec-4ac0-bfe6-e60dbaf5af28 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 1.026869 May 26 13:45:07.491512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 14/34] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:06 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:07.952951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-14a63453-2b48-4775-8c61-9121c175a436 req-a4d5fc75-c491-4c4a-a5ee-2af5f1768b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aac6ee1-e33c-4957-bb97-39e23139ba63", "tag": "1b5743b4-b6c9-449d-9b8a-dd2f82596278"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:07.960265 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:07.997499 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-14a63453-2b48-4775-8c61-9121c175a436 req-a4d5fc75-c491-4c4a-a5ee-2af5f1768b42 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:07.998575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-14a63453-2b48-4775-8c61-9121c175a436 req-a4d5fc75-c491-4c4a-a5ee-2af5f1768b42 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:08.029271 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=43 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:08.042921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-14a63453-2b48-4775-8c61-9121c175a436 req-a4d5fc75-c491-4c4a-a5ee-2af5f1768b42 service nova] Creating event network-changed:1b5743b4-b6c9-449d-9b8a-dd2f82596278 for instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 on hv-cinder-81966 May 26 13:45:08.043973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-14a63453-2b48-4775-8c61-9121c175a436 req-a4d5fc75-c491-4c4a-a5ee-2af5f1768b42 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124241) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 13:45:08.046771 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b396484-d12c-48a7-ac23-403155f273b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:08.047763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b396484-d12c-48a7-ac23-403155f273b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:08.049333 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b396484-d12c-48a7-ac23-403155f273b6 None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:08.060846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b396484-d12c-48a7-ac23-403155f273b6 None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:08.073615 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.compute.rpcapi [None req-1b396484-d12c-48a7-ac23-403155f273b6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 13:45:08.075199 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b396484-d12c-48a7-ac23-403155f273b6 None None] Releasing lock "compute-rpcapi-router" {{(pid=124241) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 13:45:08.139374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1b396484-d12c-48a7-ac23-403155f273b6 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.646294 May 26 13:45:08.140235 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 15/35] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:08.148205 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-703cb365-9fc5-4006-b05a-dabc5523f424 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:08.149601 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-703cb365-9fc5-4006-b05a-dabc5523f424 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:08.174533 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-703cb365-9fc5-4006-b05a-dabc5523f424 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:08.175010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-703cb365-9fc5-4006-b05a-dabc5523f424 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:08.175792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-703cb365-9fc5-4006-b05a-dabc5523f424 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:08.176417 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-703cb365-9fc5-4006-b05a-dabc5523f424 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:09.142942 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-703cb365-9fc5-4006-b05a-dabc5523f424 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:09.160016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-703cb365-9fc5-4006-b05a-dabc5523f424 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 1.014123 May 26 13:45:09.163470 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 16/36] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:08 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:09.183070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:09.185261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:09.230806 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:09.231259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:09.233105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:09.233694 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:10.567622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Flavor limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:45:10.568915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Image limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:45:10.569616 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Flavor pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:45:10.570209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Image pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:45:10.571513 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:45:10.580708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:10.607966 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:10.608902 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:10.611260 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:10.613022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:10.639372 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=61 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:10.662879 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Getting quotas for project 667a2ccd9c9045879b4b87e156997161. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:45:10.669281 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Getting quotas for user dd8055e46e6149d3897fb88af0b19d39 and project 667a2ccd9c9045879b4b87e156997161. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:45:10.714803 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:10.715386 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Going to run 1 instances... {{(pid=124240) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:45:10.722283 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:45:10.723833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:10.725394 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:10.740747 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-58d14cb0-2b6d-42fe-98cb-a46e39975de1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 1.561626 May 26 13:45:10.741416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 17/37] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:09 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:10.756528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0fafc94e-0c24-45c6-aef9-39df511ad1fe tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:10.762644 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0fafc94e-0c24-45c6-aef9-39df511ad1fe tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:10.789177 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fafc94e-0c24-45c6-aef9-39df511ad1fe tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:10.790360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fafc94e-0c24-45c6-aef9-39df511ad1fe tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:10.791403 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fafc94e-0c24-45c6-aef9-39df511ad1fe tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:10.791845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fafc94e-0c24-45c6-aef9-39df511ad1fe tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:11.005616 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0373c030-b609-49d9-9563-35b74331905f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.679399 May 26 13:45:11.007346 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 21/38] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:45:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 4682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:45:11.017525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-1832239e-79c1-4b3f-9b5a-f9fbc5ba896f req-98f83d5a-45b8-4dbe-b54f-a6b17be98c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef326f08-0e4f-4ad0-9f62-f4197ccf5b65", "tag": "914816b6-d98c-46f8-9da7-123cb0956236"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:11.113144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-1832239e-79c1-4b3f-9b5a-f9fbc5ba896f req-98f83d5a-45b8-4dbe-b54f-a6b17be98c64 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:11.115555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-1832239e-79c1-4b3f-9b5a-f9fbc5ba896f req-98f83d5a-45b8-4dbe-b54f-a6b17be98c64 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:11.139221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-1832239e-79c1-4b3f-9b5a-f9fbc5ba896f req-98f83d5a-45b8-4dbe-b54f-a6b17be98c64 service nova] Creating event network-changed:914816b6-d98c-46f8-9da7-123cb0956236 for instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 on hv-cinder-81966 May 26 13:45:11.141879 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-1832239e-79c1-4b3f-9b5a-f9fbc5ba896f req-98f83d5a-45b8-4dbe-b54f-a6b17be98c64 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124240) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 13:45:11.143230 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6adada3-f169-4101-89aa-289c9c21cf73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:11.144027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6adada3-f169-4101-89aa-289c9c21cf73 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:11.144999 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6adada3-f169-4101-89aa-289c9c21cf73 None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:11.145595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6adada3-f169-4101-89aa-289c9c21cf73 None None] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:11.157130 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.compute.rpcapi [None req-f6adada3-f169-4101-89aa-289c9c21cf73 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 13:45:11.158454 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6adada3-f169-4101-89aa-289c9c21cf73 None None] Releasing lock "compute-rpcapi-router" {{(pid=124240) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 13:45:11.183451 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f6adada3-f169-4101-89aa-289c9c21cf73 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173651 May 26 13:45:11.184226 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 22/39] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:11.193859 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5e8b18ff-1c0a-4295-a27d-b3874621fd66 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:11.200096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5e8b18ff-1c0a-4295-a27d-b3874621fd66 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:11.322662 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5e8b18ff-1c0a-4295-a27d-b3874621fd66 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:11.335187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5e8b18ff-1c0a-4295-a27d-b3874621fd66 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1219 microversion: 2.1 time: 0.149272 May 26 13:45:11.336442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 23/40] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:11 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:11.767294 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:11.768962 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:11.788556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:11.788556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:11.788556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:11.788556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:11.874903 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0fafc94e-0c24-45c6-aef9-39df511ad1fe tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:11.887720 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0fafc94e-0c24-45c6-aef9-39df511ad1fe tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 1.144570 May 26 13:45:11.888854 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 18/41] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:10 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:12.008215 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:12.025077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:12.027649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:12.029520 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-419f852b-52dc-4bd0-85a2-d3828b557db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.267575 May 26 13:45:12.030833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 24/42] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:11 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:12.315290 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-664559776", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96b4b46b-ed06-4350-9763-5db4d4c655a1"}], "security_groups": [{"name": "tempest-securitygroup--1740428366"}], "key_name": "tempest-keypair-901620882", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:12.353665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fdad2c62-bacb-4d0b-a20a-c7649b73776c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:12.354420 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fdad2c62-bacb-4d0b-a20a-c7649b73776c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:12.369343 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fdad2c62-bacb-4d0b-a20a-c7649b73776c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:12.372535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fdad2c62-bacb-4d0b-a20a-c7649b73776c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:12.373986 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fdad2c62-bacb-4d0b-a20a-c7649b73776c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:12.373986 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fdad2c62-bacb-4d0b-a20a-c7649b73776c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:12.473739 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] validate_networks() for [('96b4b46b-ed06-4350-9763-5db4d4c655a1', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:45:12.489220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fdad2c62-bacb-4d0b-a20a-c7649b73776c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:12.499664 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fdad2c62-bacb-4d0b-a20a-c7649b73776c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1223 microversion: 2.1 time: 0.150426 May 26 13:45:12.500177 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 25/43] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:12 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1223 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:12.905380 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-46a2da4c-95b6-4242-bbc9-d46647c64ff9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:12.906082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-46a2da4c-95b6-4242-bbc9-d46647c64ff9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:12.918643 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-46a2da4c-95b6-4242-bbc9-d46647c64ff9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:12.919390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-46a2da4c-95b6-4242-bbc9-d46647c64ff9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:12.920397 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-46a2da4c-95b6-4242-bbc9-d46647c64ff9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:12.922216 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-46a2da4c-95b6-4242-bbc9-d46647c64ff9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:13.101852 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-46a2da4c-95b6-4242-bbc9-d46647c64ff9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:13.111837 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:45:13.112417 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:45:13.112759 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:45:13.113266 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:45:13.113378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-46a2da4c-95b6-4242-bbc9-d46647c64ff9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.211635 May 26 13:45:13.113864 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:45:13.114249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 26/44] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:12 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:13.121749 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:13.122379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:13.130853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:13.131343 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:13.137338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=25 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:13.139331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:13.139978 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:13.148546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:13.149136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:13.149903 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:13.150338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:13.174186 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Getting quotas for project 2007395425194750a87edd6c0da44e66. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:45:13.180605 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Getting quotas for user 9958aaa8690c468da2acec47b2bb5f23 and project 2007395425194750a87edd6c0da44e66. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:45:13.210219 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:45:13.218467 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:45:13.313506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fc85d7d4-ecf2-43b1-8003-06a5c9db6ff7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.003447 May 26 13:45:13.317190 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 19/45] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:45:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:45:13.332946 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8976f50e-4261-4450-bd11-959f4550969c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:13.333565 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8976f50e-4261-4450-bd11-959f4550969c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:13.334754 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:13.351429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:13.355404 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:13.360607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-daf30667-bf39-46e1-b8b6-33457c63c8eb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.245066 May 26 13:45:13.361063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 27/46] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:13 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:13.408372 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8976f50e-4261-4450-bd11-959f4550969c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:13.432236 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8976f50e-4261-4450-bd11-959f4550969c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1236 microversion: 2.1 time: 0.103055 May 26 13:45:13.432841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 20/47] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:13 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:13.516439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b5a9f150-568c-4f8a-a7fd-dd35f7011601 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:13.517554 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b5a9f150-568c-4f8a-a7fd-dd35f7011601 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:13.532209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5a9f150-568c-4f8a-a7fd-dd35f7011601 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:13.532705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5a9f150-568c-4f8a-a7fd-dd35f7011601 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:13.533483 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5a9f150-568c-4f8a-a7fd-dd35f7011601 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:13.533925 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5a9f150-568c-4f8a-a7fd-dd35f7011601 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:13.610566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b5a9f150-568c-4f8a-a7fd-dd35f7011601 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:13.623299 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b5a9f150-568c-4f8a-a7fd-dd35f7011601 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1223 microversion: 2.1 time: 0.110321 May 26 13:45:13.624057 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 28/48] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:13 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:14.137284 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fa898ad5-643f-4873-bbd7-bf831ff63961 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:14.138601 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fa898ad5-643f-4873-bbd7-bf831ff63961 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:14.156675 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa898ad5-643f-4873-bbd7-bf831ff63961 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:14.157367 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa898ad5-643f-4873-bbd7-bf831ff63961 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:14.162963 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa898ad5-643f-4873-bbd7-bf831ff63961 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:14.163711 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa898ad5-643f-4873-bbd7-bf831ff63961 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:14.379520 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:14.380133 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:14.396938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:14.397456 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:14.404740 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:14.407331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:14.672560 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:14.687327 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:14.688958 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:14.690109 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b7d8fd5d-58ac-46ab-84ad-94855950f368 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.315140 May 26 13:45:14.691450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 29/49] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:14 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:14.693613 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fa898ad5-643f-4873-bbd7-bf831ff63961 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:14.696459 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-691b6b6c-4324-4dc6-a455-27701455accb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:14.697288 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-691b6b6c-4324-4dc6-a455-27701455accb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:14.708374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fa898ad5-643f-4873-bbd7-bf831ff63961 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.580960 May 26 13:45:14.709036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 21/50] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:14 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:14.709716 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-691b6b6c-4324-4dc6-a455-27701455accb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:14.712737 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-691b6b6c-4324-4dc6-a455-27701455accb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:14.713867 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-691b6b6c-4324-4dc6-a455-27701455accb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:14.714737 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-691b6b6c-4324-4dc6-a455-27701455accb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:14.730303 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-901a0de9-f0c2-42ba-bb14-992ca12e003f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:14.731145 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-901a0de9-f0c2-42ba-bb14-992ca12e003f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:14.748558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-901a0de9-f0c2-42ba-bb14-992ca12e003f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:14.751753 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-901a0de9-f0c2-42ba-bb14-992ca12e003f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:14.753291 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-901a0de9-f0c2-42ba-bb14-992ca12e003f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:14.754960 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-901a0de9-f0c2-42ba-bb14-992ca12e003f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:14.849079 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-691b6b6c-4324-4dc6-a455-27701455accb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:14.870841 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-691b6b6c-4324-4dc6-a455-27701455accb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.177953 May 26 13:45:14.874234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 30/51] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:14 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:14.892242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-901a0de9-f0c2-42ba-bb14-992ca12e003f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:14.901045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-901a0de9-f0c2-42ba-bb14-992ca12e003f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.181807 May 26 13:45:14.905943 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 22/52] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:14 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:15.192429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-e876edd6-8576-4224-b56c-d24109f32bac req-d50d89aa-75db-4c5f-961c-0f1b31dedeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6527206-c7a2-4458-97ed-915ee9b16cfb", "tag": "cbc63303-0423-4bdd-8895-788f378a4ced"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:15.203074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e876edd6-8576-4224-b56c-d24109f32bac req-d50d89aa-75db-4c5f-961c-0f1b31dedeb0 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.203537 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e876edd6-8576-4224-b56c-d24109f32bac req-d50d89aa-75db-4c5f-961c-0f1b31dedeb0 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.215573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-e876edd6-8576-4224-b56c-d24109f32bac req-d50d89aa-75db-4c5f-961c-0f1b31dedeb0 service nova] Creating event network-changed:cbc63303-0423-4bdd-8895-788f378a4ced for instance c6527206-c7a2-4458-97ed-915ee9b16cfb on hv-cinder-81966 May 26 13:45:15.225153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-e876edd6-8576-4224-b56c-d24109f32bac req-d50d89aa-75db-4c5f-961c-0f1b31dedeb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118053 May 26 13:45:15.226128 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 31/53] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:15.709212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:15.709815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:15.716563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.717008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.717760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.718189 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.725506 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-09abb76a-c8cf-415d-83e8-3d2b7669b0ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:15.726783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-09abb76a-c8cf-415d-83e8-3d2b7669b0ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:15.732768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09abb76a-c8cf-415d-83e8-3d2b7669b0ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.733219 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09abb76a-c8cf-415d-83e8-3d2b7669b0ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.733985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09abb76a-c8cf-415d-83e8-3d2b7669b0ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.734423 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09abb76a-c8cf-415d-83e8-3d2b7669b0ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.872364 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-09abb76a-c8cf-415d-83e8-3d2b7669b0ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:15.880217 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-09abb76a-c8cf-415d-83e8-3d2b7669b0ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.158801 May 26 13:45:15.880834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 32/54] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:15 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:15.889856 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5ba1aa74-0ea6-4aa8-820b-cda222bb1f87 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:15.890463 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5ba1aa74-0ea6-4aa8-820b-cda222bb1f87 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:15.896731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ba1aa74-0ea6-4aa8-820b-cda222bb1f87 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.897177 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ba1aa74-0ea6-4aa8-820b-cda222bb1f87 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.897943 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ba1aa74-0ea6-4aa8-820b-cda222bb1f87 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.898417 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ba1aa74-0ea6-4aa8-820b-cda222bb1f87 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.965995 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5ba1aa74-0ea6-4aa8-820b-cda222bb1f87 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:15.973520 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5ba1aa74-0ea6-4aa8-820b-cda222bb1f87 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.087512 May 26 13:45:15.974099 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 33/55] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:15 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:15.983052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d7e55847-f91c-4063-a343-bc7fddd0033a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:15.983052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d7e55847-f91c-4063-a343-bc7fddd0033a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:15.985318 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7e55847-f91c-4063-a343-bc7fddd0033a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.985776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7e55847-f91c-4063-a343-bc7fddd0033a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.986548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7e55847-f91c-4063-a343-bc7fddd0033a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:15.986986 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7e55847-f91c-4063-a343-bc7fddd0033a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:15.998853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:16.007039 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:16.009330 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:16.010455 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-55aa05cd-5dcc-4c56-befd-f38a941cf661 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.305244 May 26 13:45:16.011028 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 23/56] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:15 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:16.050164 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d7e55847-f91c-4063-a343-bc7fddd0033a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:16.058344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d7e55847-f91c-4063-a343-bc7fddd0033a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.083203 May 26 13:45:16.058920 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 34/57] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:15 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:16.897998 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-993b138c-690e-4ded-b9b7-efb3fe90c684 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:16.899165 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-993b138c-690e-4ded-b9b7-efb3fe90c684 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:16.905166 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-993b138c-690e-4ded-b9b7-efb3fe90c684 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:16.905603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-993b138c-690e-4ded-b9b7-efb3fe90c684 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:16.906350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-993b138c-690e-4ded-b9b7-efb3fe90c684 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:16.906774 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-993b138c-690e-4ded-b9b7-efb3fe90c684 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:16.990606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6765f360-8e62-4495-9b70-f1116588d93d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:16.991872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6765f360-8e62-4495-9b70-f1116588d93d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:16.998032 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6765f360-8e62-4495-9b70-f1116588d93d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:16.998462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6765f360-8e62-4495-9b70-f1116588d93d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:16.999269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6765f360-8e62-4495-9b70-f1116588d93d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:17.000230 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6765f360-8e62-4495-9b70-f1116588d93d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:17.051249 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-993b138c-690e-4ded-b9b7-efb3fe90c684 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:17.058904 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-993b138c-690e-4ded-b9b7-efb3fe90c684 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.164792 May 26 13:45:17.059493 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 24/58] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:16 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:17.064464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:17.065069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:17.065183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6765f360-8e62-4495-9b70-f1116588d93d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:17.071936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:17.072413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:17.073385 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6765f360-8e62-4495-9b70-f1116588d93d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.086651 May 26 13:45:17.073509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:17.073965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:17.074067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 35/59] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:16 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:17.078623 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7da37a70-4ca1-40b8-8545-c5813e792585 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:17.079234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7da37a70-4ca1-40b8-8545-c5813e792585 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:17.085158 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7da37a70-4ca1-40b8-8545-c5813e792585 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:17.085600 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7da37a70-4ca1-40b8-8545-c5813e792585 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:17.086935 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7da37a70-4ca1-40b8-8545-c5813e792585 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:17.087484 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7da37a70-4ca1-40b8-8545-c5813e792585 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:17.149843 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7da37a70-4ca1-40b8-8545-c5813e792585 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:17.157268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7da37a70-4ca1-40b8-8545-c5813e792585 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.082359 May 26 13:45:17.157846 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 36/60] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:17 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:17.210698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:17.219425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:17.220984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:17.222097 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-be07f253-f6a7-4ab4-b911-4da751dee313 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.161505 May 26 13:45:17.222677 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 25/61] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:17 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:18.077222 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2392e9b5-7aa6-4e25-aca1-46646c9141ef tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:18.077784 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2392e9b5-7aa6-4e25-aca1-46646c9141ef tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:18.083939 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2392e9b5-7aa6-4e25-aca1-46646c9141ef tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:18.084413 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2392e9b5-7aa6-4e25-aca1-46646c9141ef tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:18.085496 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2392e9b5-7aa6-4e25-aca1-46646c9141ef tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:18.086540 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2392e9b5-7aa6-4e25-aca1-46646c9141ef tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:18.090538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b40c1add-1d6c-4ef7-8784-5c9df0f48dc0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:18.091154 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b40c1add-1d6c-4ef7-8784-5c9df0f48dc0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:18.097387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b40c1add-1d6c-4ef7-8784-5c9df0f48dc0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:18.097871 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b40c1add-1d6c-4ef7-8784-5c9df0f48dc0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:18.098644 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b40c1add-1d6c-4ef7-8784-5c9df0f48dc0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:18.099078 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b40c1add-1d6c-4ef7-8784-5c9df0f48dc0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:18.161565 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b40c1add-1d6c-4ef7-8784-5c9df0f48dc0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:18.170086 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b40c1add-1d6c-4ef7-8784-5c9df0f48dc0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.083793 May 26 13:45:18.170682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 26/62] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:18 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:18.180028 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8bfa0508-31c9-487a-8bd1-86d20f932a69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:18.180752 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8bfa0508-31c9-487a-8bd1-86d20f932a69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:18.186911 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bfa0508-31c9-487a-8bd1-86d20f932a69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:18.187358 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bfa0508-31c9-487a-8bd1-86d20f932a69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:18.188121 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bfa0508-31c9-487a-8bd1-86d20f932a69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:18.188605 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bfa0508-31c9-487a-8bd1-86d20f932a69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:18.229429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2392e9b5-7aa6-4e25-aca1-46646c9141ef tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:18.237958 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2392e9b5-7aa6-4e25-aca1-46646c9141ef tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.165128 May 26 13:45:18.238532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 37/63] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:18 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:18.244297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:18.244922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:18.251235 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8bfa0508-31c9-487a-8bd1-86d20f932a69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:18.252035 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:18.252682 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:18.253421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:18.253850 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:18.259480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8bfa0508-31c9-487a-8bd1-86d20f932a69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.083774 May 26 13:45:18.260060 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 27/64] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:18 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:18.388117 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:18.396207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:18.397731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:18.399040 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ee448a1b-aaf8-43ab-84b7-db34170800e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.159320 May 26 13:45:18.399603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 38/65] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:18 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:19.187163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cb5cb768-9ac5-4cee-99b3-1e235f5e1762 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:19.187904 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cb5cb768-9ac5-4cee-99b3-1e235f5e1762 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:19.194008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb5cb768-9ac5-4cee-99b3-1e235f5e1762 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:19.194456 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb5cb768-9ac5-4cee-99b3-1e235f5e1762 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:19.195603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb5cb768-9ac5-4cee-99b3-1e235f5e1762 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:19.196296 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb5cb768-9ac5-4cee-99b3-1e235f5e1762 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:19.255458 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dd1f9063-f08f-4201-a646-5d2b49ea6abc tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:19.256091 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dd1f9063-f08f-4201-a646-5d2b49ea6abc tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:19.263105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cb5cb768-9ac5-4cee-99b3-1e235f5e1762 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:19.263546 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dd1f9063-f08f-4201-a646-5d2b49ea6abc tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:19.264076 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dd1f9063-f08f-4201-a646-5d2b49ea6abc tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:19.264962 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dd1f9063-f08f-4201-a646-5d2b49ea6abc tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:19.265469 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dd1f9063-f08f-4201-a646-5d2b49ea6abc tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:19.274153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cb5cb768-9ac5-4cee-99b3-1e235f5e1762 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.089831 May 26 13:45:19.275320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 28/66] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:19 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:19.279957 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1073cba8-2cae-4d90-b849-807f6c0eb416 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:19.280612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1073cba8-2cae-4d90-b849-807f6c0eb416 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:19.286993 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1073cba8-2cae-4d90-b849-807f6c0eb416 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:19.287447 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1073cba8-2cae-4d90-b849-807f6c0eb416 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:19.288209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1073cba8-2cae-4d90-b849-807f6c0eb416 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:19.288683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1073cba8-2cae-4d90-b849-807f6c0eb416 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:19.361827 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1073cba8-2cae-4d90-b849-807f6c0eb416 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:19.369872 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1073cba8-2cae-4d90-b849-807f6c0eb416 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.093378 May 26 13:45:19.370480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 29/67] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:19 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:19.413676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dd1f9063-f08f-4201-a646-5d2b49ea6abc tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:19.420517 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:19.421115 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:19.422442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dd1f9063-f08f-4201-a646-5d2b49ea6abc tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.170854 May 26 13:45:19.423115 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 39/68] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:19 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:19.427257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:19.427701 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:19.428622 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:19.429016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:19.560815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:19.569752 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:19.572136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:19.573546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-776cef14-0f6e-4793-b1e4-54be4c5def92 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.156637 May 26 13:45:19.574106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 30/69] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:19 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:20.294949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3f8383c6-81a5-44b8-aa24-ad20ebf80382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:20.295678 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3f8383c6-81a5-44b8-aa24-ad20ebf80382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:20.301955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3f8383c6-81a5-44b8-aa24-ad20ebf80382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:20.302498 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3f8383c6-81a5-44b8-aa24-ad20ebf80382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:20.303397 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3f8383c6-81a5-44b8-aa24-ad20ebf80382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:20.303938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3f8383c6-81a5-44b8-aa24-ad20ebf80382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:20.319649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:20.372695 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3f8383c6-81a5-44b8-aa24-ad20ebf80382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:20.380106 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3f8383c6-81a5-44b8-aa24-ad20ebf80382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.089215 May 26 13:45:20.380897 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 40/70] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:20 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:20.386682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6d66753a-47f7-4255-96f6-74349f104048 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:20.387312 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6d66753a-47f7-4255-96f6-74349f104048 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:20.394807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d66753a-47f7-4255-96f6-74349f104048 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:20.395266 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d66753a-47f7-4255-96f6-74349f104048 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:20.396036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d66753a-47f7-4255-96f6-74349f104048 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:20.396508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d66753a-47f7-4255-96f6-74349f104048 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:20.442019 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-09ebb617-a85e-4f2a-ac58-d7dd456a298a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:20.443080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-09ebb617-a85e-4f2a-ac58-d7dd456a298a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:20.450121 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09ebb617-a85e-4f2a-ac58-d7dd456a298a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:20.450586 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09ebb617-a85e-4f2a-ac58-d7dd456a298a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:20.451368 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09ebb617-a85e-4f2a-ac58-d7dd456a298a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:20.451811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09ebb617-a85e-4f2a-ac58-d7dd456a298a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:20.478093 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6d66753a-47f7-4255-96f6-74349f104048 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:20.487327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6d66753a-47f7-4255-96f6-74349f104048 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.104623 May 26 13:45:20.487912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 31/71] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:20 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:20.592179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:20.592847 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:20.596539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-09ebb617-a85e-4f2a-ac58-d7dd456a298a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:20.599203 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:20.599657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:20.600459 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:20.600901 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:20.604938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-09ebb617-a85e-4f2a-ac58-d7dd456a298a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.167713 May 26 13:45:20.605510 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 41/72] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:20 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:20.734023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:20.742612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:20.744142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:20.745294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1cc932ec-b44d-4f52-9f29-71e332902d6a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.157071 May 26 13:45:20.745865 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 32/73] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:20 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:45:21.400892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dc9a042e-6bd3-4d2e-a05b-fca1dc9b252e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:21.401499 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dc9a042e-6bd3-4d2e-a05b-fca1dc9b252e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:21.403519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=4 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:21.404070 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=14 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:21.410276 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc9a042e-6bd3-4d2e-a05b-fca1dc9b252e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:21.410797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc9a042e-6bd3-4d2e-a05b-fca1dc9b252e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:21.411497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc9a042e-6bd3-4d2e-a05b-fca1dc9b252e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:21.411933 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc9a042e-6bd3-4d2e-a05b-fca1dc9b252e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:21.480460 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dc9a042e-6bd3-4d2e-a05b-fca1dc9b252e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:21.488725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dc9a042e-6bd3-4d2e-a05b-fca1dc9b252e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.093246 May 26 13:45:21.490296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 42/74] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:21 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:21.508838 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-51be81fa-1a7b-4b1b-84be-4860a703101d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:21.509473 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-51be81fa-1a7b-4b1b-84be-4860a703101d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:21.516541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51be81fa-1a7b-4b1b-84be-4860a703101d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:21.517044 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51be81fa-1a7b-4b1b-84be-4860a703101d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:21.517834 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51be81fa-1a7b-4b1b-84be-4860a703101d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:21.518290 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51be81fa-1a7b-4b1b-84be-4860a703101d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:21.592079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-51be81fa-1a7b-4b1b-84be-4860a703101d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:21.594335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:21.601052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-51be81fa-1a7b-4b1b-84be-4860a703101d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.097410 May 26 13:45:21.602451 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 33/75] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:21 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:21.623595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e077f6ed-ac82-4255-bcd2-86357a1b2f7e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:21.624388 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e077f6ed-ac82-4255-bcd2-86357a1b2f7e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:21.631135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e077f6ed-ac82-4255-bcd2-86357a1b2f7e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:21.631586 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e077f6ed-ac82-4255-bcd2-86357a1b2f7e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:21.632972 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e077f6ed-ac82-4255-bcd2-86357a1b2f7e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:21.633451 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e077f6ed-ac82-4255-bcd2-86357a1b2f7e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:21.767264 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:21.767903 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:21.771836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e077f6ed-ac82-4255-bcd2-86357a1b2f7e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:21.774221 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:21.774668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:21.775431 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:21.775860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:21.779954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e077f6ed-ac82-4255-bcd2-86357a1b2f7e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.161039 May 26 13:45:21.780655 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 43/76] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:21 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:21.905130 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:21.914317 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:21.916022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:21.917189 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-edf1cb41-f622-42d2-a7bb-a83c0bfa82b2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.153941 May 26 13:45:21.917761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 34/77] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:21 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:45:22.507156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-704e31ba-0d6a-4c18-87d0-e5874ae0ca8d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:22.508420 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-704e31ba-0d6a-4c18-87d0-e5874ae0ca8d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:22.514520 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-704e31ba-0d6a-4c18-87d0-e5874ae0ca8d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:22.514964 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-704e31ba-0d6a-4c18-87d0-e5874ae0ca8d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:22.515726 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-704e31ba-0d6a-4c18-87d0-e5874ae0ca8d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:22.516162 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-704e31ba-0d6a-4c18-87d0-e5874ae0ca8d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:22.580185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-704e31ba-0d6a-4c18-87d0-e5874ae0ca8d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:22.588368 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-704e31ba-0d6a-4c18-87d0-e5874ae0ca8d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.085160 May 26 13:45:22.588941 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 44/78] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:22 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:22.623003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3699d8e5-a37e-4fe8-92df-45eeace7bb27 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:22.623719 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3699d8e5-a37e-4fe8-92df-45eeace7bb27 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:22.630110 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3699d8e5-a37e-4fe8-92df-45eeace7bb27 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:22.630561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3699d8e5-a37e-4fe8-92df-45eeace7bb27 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:22.631328 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3699d8e5-a37e-4fe8-92df-45eeace7bb27 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:22.631814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3699d8e5-a37e-4fe8-92df-45eeace7bb27 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:22.698971 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3699d8e5-a37e-4fe8-92df-45eeace7bb27 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:22.706399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3699d8e5-a37e-4fe8-92df-45eeace7bb27 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.088102 May 26 13:45:22.706962 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 35/79] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:22 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:22.798913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a47cf5fa-0391-4b24-9b81-5c676d4571e1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:22.799532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a47cf5fa-0391-4b24-9b81-5c676d4571e1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:22.806737 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a47cf5fa-0391-4b24-9b81-5c676d4571e1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:22.807186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a47cf5fa-0391-4b24-9b81-5c676d4571e1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:22.807978 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a47cf5fa-0391-4b24-9b81-5c676d4571e1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:22.808462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a47cf5fa-0391-4b24-9b81-5c676d4571e1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:22.937128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:22.937740 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:22.943795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:22.944474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:22.946214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:22.946654 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:22.952437 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a47cf5fa-0391-4b24-9b81-5c676d4571e1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:22.960178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a47cf5fa-0391-4b24-9b81-5c676d4571e1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.165143 May 26 13:45:22.960922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 45/80] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:22 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:23.081331 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:23.090536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:23.092048 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:23.093200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-289b2f84-909c-4fa3-88a8-dd7d26508f2c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.160293 May 26 13:45:23.093769 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 36/81] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:22 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:23.605034 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a3aac62e-afdc-4695-8261-1821bb76b0e8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:23.605634 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a3aac62e-afdc-4695-8261-1821bb76b0e8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:23.611585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3aac62e-afdc-4695-8261-1821bb76b0e8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:23.612026 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3aac62e-afdc-4695-8261-1821bb76b0e8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:23.612815 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3aac62e-afdc-4695-8261-1821bb76b0e8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:23.613242 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3aac62e-afdc-4695-8261-1821bb76b0e8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:23.675534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a3aac62e-afdc-4695-8261-1821bb76b0e8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:23.683828 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a3aac62e-afdc-4695-8261-1821bb76b0e8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.082717 May 26 13:45:23.684405 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 46/82] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:23 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:23.723830 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-02849371-f1f7-4e2a-88ca-3b43f1664c2f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:23.724437 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-02849371-f1f7-4e2a-88ca-3b43f1664c2f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:23.726376 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:23.727181 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=7 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:23.733914 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02849371-f1f7-4e2a-88ca-3b43f1664c2f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:23.734498 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02849371-f1f7-4e2a-88ca-3b43f1664c2f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:23.735325 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02849371-f1f7-4e2a-88ca-3b43f1664c2f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:23.735831 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02849371-f1f7-4e2a-88ca-3b43f1664c2f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:23.797043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-02849371-f1f7-4e2a-88ca-3b43f1664c2f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:23.805226 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-02849371-f1f7-4e2a-88ca-3b43f1664c2f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.085383 May 26 13:45:23.805845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 37/83] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:23 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:23.977955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4113b283-6105-4785-a520-6b693682b066 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:23.978497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4113b283-6105-4785-a520-6b693682b066 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:23.984619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4113b283-6105-4785-a520-6b693682b066 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:23.985072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4113b283-6105-4785-a520-6b693682b066 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:23.985868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4113b283-6105-4785-a520-6b693682b066 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:23.986302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4113b283-6105-4785-a520-6b693682b066 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:24.111895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:24.112527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:24.119208 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4113b283-6105-4785-a520-6b693682b066 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:24.120025 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:24.120514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:24.121287 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:24.121718 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:24.127366 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4113b283-6105-4785-a520-6b693682b066 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.154022 May 26 13:45:24.127945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 47/84] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:23 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:24.265930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:24.275063 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:24.276612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:24.277741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-31b1ca7a-6e4f-4288-9a14-b30841c3a3bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.170572 May 26 13:45:24.278320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 38/85] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:24 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:24.702080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-49dccb96-2b90-4f90-bbf1-ea442c58cd8a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:24.702747 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-49dccb96-2b90-4f90-bbf1-ea442c58cd8a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:24.709027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49dccb96-2b90-4f90-bbf1-ea442c58cd8a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:24.709758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49dccb96-2b90-4f90-bbf1-ea442c58cd8a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:24.711151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49dccb96-2b90-4f90-bbf1-ea442c58cd8a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:24.711618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49dccb96-2b90-4f90-bbf1-ea442c58cd8a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:24.777477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-49dccb96-2b90-4f90-bbf1-ea442c58cd8a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:24.784927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-49dccb96-2b90-4f90-bbf1-ea442c58cd8a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.086920 May 26 13:45:24.785497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 48/86] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:24 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:24.822681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8e047f02-21e4-4333-817c-c9b916aa2fab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:24.823559 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8e047f02-21e4-4333-817c-c9b916aa2fab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:24.829777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e047f02-21e4-4333-817c-c9b916aa2fab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:24.830218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e047f02-21e4-4333-817c-c9b916aa2fab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:24.830969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e047f02-21e4-4333-817c-c9b916aa2fab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:24.831395 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e047f02-21e4-4333-817c-c9b916aa2fab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:24.891928 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e047f02-21e4-4333-817c-c9b916aa2fab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:24.900261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8e047f02-21e4-4333-817c-c9b916aa2fab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.081875 May 26 13:45:24.900869 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 39/87] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:24 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:25.143996 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6f007c2c-5644-4dea-8d86-d63d8fc6d6ec tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:25.144637 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6f007c2c-5644-4dea-8d86-d63d8fc6d6ec tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:25.150907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6f007c2c-5644-4dea-8d86-d63d8fc6d6ec tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:25.151351 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6f007c2c-5644-4dea-8d86-d63d8fc6d6ec tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:25.152131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6f007c2c-5644-4dea-8d86-d63d8fc6d6ec tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:25.152572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6f007c2c-5644-4dea-8d86-d63d8fc6d6ec tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:25.283929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6f007c2c-5644-4dea-8d86-d63d8fc6d6ec tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:25.292647 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6f007c2c-5644-4dea-8d86-d63d8fc6d6ec tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.152406 May 26 13:45:25.293443 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 49/88] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:25 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:25.295401 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:25.296193 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:25.302297 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:25.302748 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:25.303536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:25.303980 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:25.470668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:25.481691 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:25.484447 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:25.485780 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f32a9079-0c3a-45eb-b559-5885521674a5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.194589 May 26 13:45:25.486350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 40/89] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:25 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:25.801692 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d47ca1ff-b7c5-41c5-9ea4-aa36284e89fb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:25.802361 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d47ca1ff-b7c5-41c5-9ea4-aa36284e89fb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:25.810462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d47ca1ff-b7c5-41c5-9ea4-aa36284e89fb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:25.811155 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d47ca1ff-b7c5-41c5-9ea4-aa36284e89fb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:25.812622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d47ca1ff-b7c5-41c5-9ea4-aa36284e89fb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:25.813068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d47ca1ff-b7c5-41c5-9ea4-aa36284e89fb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:25.888847 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d47ca1ff-b7c5-41c5-9ea4-aa36284e89fb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:25.896730 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d47ca1ff-b7c5-41c5-9ea4-aa36284e89fb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.098821 May 26 13:45:25.906398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 50/90] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:25 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:25.917986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-77ca79c6-d073-4801-b170-51a6b571b1e8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:25.918759 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-77ca79c6-d073-4801-b170-51a6b571b1e8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:25.925150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77ca79c6-d073-4801-b170-51a6b571b1e8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:25.925670 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77ca79c6-d073-4801-b170-51a6b571b1e8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:25.926439 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77ca79c6-d073-4801-b170-51a6b571b1e8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:25.927044 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-77ca79c6-d073-4801-b170-51a6b571b1e8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:25.995901 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-77ca79c6-d073-4801-b170-51a6b571b1e8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:26.003757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-77ca79c6-d073-4801-b170-51a6b571b1e8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.090742 May 26 13:45:26.004340 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 41/91] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:25 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:26.310248 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-cd16a34c-a060-4830-b2ad-fff22236b8d1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:26.310890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-cd16a34c-a060-4830-b2ad-fff22236b8d1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:26.316857 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cd16a34c-a060-4830-b2ad-fff22236b8d1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:26.317307 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cd16a34c-a060-4830-b2ad-fff22236b8d1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:26.318060 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cd16a34c-a060-4830-b2ad-fff22236b8d1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:26.318534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cd16a34c-a060-4830-b2ad-fff22236b8d1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:26.455234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-cd16a34c-a060-4830-b2ad-fff22236b8d1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:26.463499 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-cd16a34c-a060-4830-b2ad-fff22236b8d1 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.157389 May 26 13:45:26.464289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 51/92] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:26 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:26.505104 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:26.505989 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:26.514224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:26.514893 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:26.515744 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:26.516423 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:26.663323 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:26.672535 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:26.674270 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:26.675716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-094238b0-cc6c-45ee-9d6f-2c6345bbfb6b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.174546 May 26 13:45:26.676170 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 42/93] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:26 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:26.916475 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f92c7ccf-4994-49eb-a993-6de0502d3091 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:26.917213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f92c7ccf-4994-49eb-a993-6de0502d3091 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:26.925085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f92c7ccf-4994-49eb-a993-6de0502d3091 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:26.925626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f92c7ccf-4994-49eb-a993-6de0502d3091 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:26.927137 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f92c7ccf-4994-49eb-a993-6de0502d3091 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:26.927684 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f92c7ccf-4994-49eb-a993-6de0502d3091 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:27.006026 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f92c7ccf-4994-49eb-a993-6de0502d3091 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:27.011744 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f92c7ccf-4994-49eb-a993-6de0502d3091 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.100408 May 26 13:45:27.012651 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 52/94] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:26 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:27.020943 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3722a758-9f9f-4941-8d25-7c57da34bf51 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:27.021647 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3722a758-9f9f-4941-8d25-7c57da34bf51 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:27.030565 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3722a758-9f9f-4941-8d25-7c57da34bf51 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:27.031021 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3722a758-9f9f-4941-8d25-7c57da34bf51 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:27.031808 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3722a758-9f9f-4941-8d25-7c57da34bf51 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:27.032235 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3722a758-9f9f-4941-8d25-7c57da34bf51 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:27.196615 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3722a758-9f9f-4941-8d25-7c57da34bf51 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:27.209352 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3722a758-9f9f-4941-8d25-7c57da34bf51 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.191819 May 26 13:45:27.210482 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-a067c8d7-0449-48ac-8d72-c7c474e9d088 req-37c151cc-c8b0-46a3-983e-810d99e83cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac6ee1-e33c-4957-bb97-39e23139ba63", "name": "network-vif-plugged", "status": "completed", "tag": "1b5743b4-b6c9-449d-9b8a-dd2f82596278"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:27.212106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 43/95] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:27 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:27.221462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-a067c8d7-0449-48ac-8d72-c7c474e9d088 req-37c151cc-c8b0-46a3-983e-810d99e83cf4 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:27.221909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-a067c8d7-0449-48ac-8d72-c7c474e9d088 req-37c151cc-c8b0-46a3-983e-810d99e83cf4 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:27.236891 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-a067c8d7-0449-48ac-8d72-c7c474e9d088 req-37c151cc-c8b0-46a3-983e-810d99e83cf4 service nova] Creating event network-vif-plugged:1b5743b4-b6c9-449d-9b8a-dd2f82596278 for instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 on hv-cinder-81966 May 26 13:45:27.243278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-a067c8d7-0449-48ac-8d72-c7c474e9d088 req-37c151cc-c8b0-46a3-983e-810d99e83cf4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095360 May 26 13:45:27.243898 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 53/96] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:45:27.481411 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-118cc34b-2c60-4849-90c5-f30a3ac502c9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:27.482141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-118cc34b-2c60-4849-90c5-f30a3ac502c9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:27.488653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-118cc34b-2c60-4849-90c5-f30a3ac502c9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:27.489213 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-118cc34b-2c60-4849-90c5-f30a3ac502c9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:27.490526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-118cc34b-2c60-4849-90c5-f30a3ac502c9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:27.491037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-118cc34b-2c60-4849-90c5-f30a3ac502c9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:27.634963 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-118cc34b-2c60-4849-90c5-f30a3ac502c9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:27.642672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-118cc34b-2c60-4849-90c5-f30a3ac502c9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.165012 May 26 13:45:27.643263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 44/97] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:27 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:27.695464 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:27.696140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:27.702606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:27.703052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:27.703812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:27.704248 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:27.847916 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:27.862315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:27.863936 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:27.865153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fa410ed4-01fd-409f-bc0d-e58f0208c5f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.174015 May 26 13:45:27.865795 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 54/98] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:27 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:28.028509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e936c569-085c-4dbc-800c-ac0aa9f0c1ee tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:28.029291 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e936c569-085c-4dbc-800c-ac0aa9f0c1ee tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:28.035261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e936c569-085c-4dbc-800c-ac0aa9f0c1ee tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:28.035709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e936c569-085c-4dbc-800c-ac0aa9f0c1ee tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:28.036510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e936c569-085c-4dbc-800c-ac0aa9f0c1ee tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:28.036948 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e936c569-085c-4dbc-800c-ac0aa9f0c1ee tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:28.111006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e936c569-085c-4dbc-800c-ac0aa9f0c1ee tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:28.119812 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e936c569-085c-4dbc-800c-ac0aa9f0c1ee tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.095134 May 26 13:45:28.120405 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 45/99] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:28 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:28.227149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6e91ff83-cee5-4f4a-940b-ad9575a17f5d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:28.227788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6e91ff83-cee5-4f4a-940b-ad9575a17f5d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:28.233882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6e91ff83-cee5-4f4a-940b-ad9575a17f5d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:28.234332 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6e91ff83-cee5-4f4a-940b-ad9575a17f5d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:28.235200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6e91ff83-cee5-4f4a-940b-ad9575a17f5d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:28.235637 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6e91ff83-cee5-4f4a-940b-ad9575a17f5d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:28.308125 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6e91ff83-cee5-4f4a-940b-ad9575a17f5d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:28.315468 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6e91ff83-cee5-4f4a-940b-ad9575a17f5d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.092179 May 26 13:45:28.316042 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 55/100] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:28 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:28.660183 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-006d7d70-0b48-40a9-be7f-87e2db3f052a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:28.660822 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-006d7d70-0b48-40a9-be7f-87e2db3f052a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:28.667012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-006d7d70-0b48-40a9-be7f-87e2db3f052a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:28.667459 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-006d7d70-0b48-40a9-be7f-87e2db3f052a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:28.668226 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-006d7d70-0b48-40a9-be7f-87e2db3f052a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:28.668879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-006d7d70-0b48-40a9-be7f-87e2db3f052a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:28.814177 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-006d7d70-0b48-40a9-be7f-87e2db3f052a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:28.826835 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-006d7d70-0b48-40a9-be7f-87e2db3f052a tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.167780 May 26 13:45:28.826835 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 46/101] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:28 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:28.894107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:28.895150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:28.905652 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:28.906102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:28.906871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:28.907304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:29.049281 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:29.057984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:29.059474 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:29.060599 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bb18df0e-a2ec-4fa3-9f71-ccb66c5f6fee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.175387 May 26 13:45:29.061159 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 56/102] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:28 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:29.136843 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b8bcf8bc-6bdc-4328-98e3-8eca03bbd3e3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:29.137450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b8bcf8bc-6bdc-4328-98e3-8eca03bbd3e3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:29.143316 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8bcf8bc-6bdc-4328-98e3-8eca03bbd3e3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:29.143757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8bcf8bc-6bdc-4328-98e3-8eca03bbd3e3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:29.144543 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8bcf8bc-6bdc-4328-98e3-8eca03bbd3e3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:29.144973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8bcf8bc-6bdc-4328-98e3-8eca03bbd3e3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:29.206015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b8bcf8bc-6bdc-4328-98e3-8eca03bbd3e3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:29.214380 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b8bcf8bc-6bdc-4328-98e3-8eca03bbd3e3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.081252 May 26 13:45:29.215234 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 47/103] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:29 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:29.333254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0d153974-5a20-4a2f-9d23-c90c53f0bb96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:29.333888 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0d153974-5a20-4a2f-9d23-c90c53f0bb96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:29.340840 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0d153974-5a20-4a2f-9d23-c90c53f0bb96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:29.341286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0d153974-5a20-4a2f-9d23-c90c53f0bb96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:29.342059 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0d153974-5a20-4a2f-9d23-c90c53f0bb96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:29.342499 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0d153974-5a20-4a2f-9d23-c90c53f0bb96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:29.424671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0d153974-5a20-4a2f-9d23-c90c53f0bb96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:29.427006 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:29.434256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0d153974-5a20-4a2f-9d23-c90c53f0bb96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.104721 May 26 13:45:29.434849 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 57/104] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:29 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:29.841715 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ba618298-c673-4a61-af06-d98c3a18ba76 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:29.842874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ba618298-c673-4a61-af06-d98c3a18ba76 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:29.854143 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba618298-c673-4a61-af06-d98c3a18ba76 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:29.854909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba618298-c673-4a61-af06-d98c3a18ba76 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:29.855893 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba618298-c673-4a61-af06-d98c3a18ba76 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:29.857057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ba618298-c673-4a61-af06-d98c3a18ba76 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:30.027361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ba618298-c673-4a61-af06-d98c3a18ba76 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:30.035709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ba618298-c673-4a61-af06-d98c3a18ba76 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.198501 May 26 13:45:30.036459 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 48/105] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:29 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:30.079236 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:30.079835 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:30.086703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:30.087145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:30.087900 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:30.088347 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:30.221185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:30.230708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:30.230923 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-03ac3060-3d82-466a-acdc-6be772465720 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:30.231400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-03ac3060-3d82-466a-acdc-6be772465720 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:30.232225 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:30.233937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-146d9f44-5756-4d70-bdd9-a91dddee165d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.158584 May 26 13:45:30.235514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 58/106] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:30 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:30.249548 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03ac3060-3d82-466a-acdc-6be772465720 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:30.250355 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03ac3060-3d82-466a-acdc-6be772465720 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:30.251186 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03ac3060-3d82-466a-acdc-6be772465720 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:30.251620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-03ac3060-3d82-466a-acdc-6be772465720 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:30.314355 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-03ac3060-3d82-466a-acdc-6be772465720 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:30.321811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-03ac3060-3d82-466a-acdc-6be772465720 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.094716 May 26 13:45:30.322587 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 49/107] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:30 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:30.450705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-476a2f0d-f7e1-4acc-81ae-6326510a14d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:30.451440 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-476a2f0d-f7e1-4acc-81ae-6326510a14d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:30.457751 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-476a2f0d-f7e1-4acc-81ae-6326510a14d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:30.458313 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-476a2f0d-f7e1-4acc-81ae-6326510a14d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:30.459132 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-476a2f0d-f7e1-4acc-81ae-6326510a14d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:30.459565 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-476a2f0d-f7e1-4acc-81ae-6326510a14d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:30.520371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-476a2f0d-f7e1-4acc-81ae-6326510a14d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:30.528550 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-476a2f0d-f7e1-4acc-81ae-6326510a14d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.082054 May 26 13:45:30.529134 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 59/108] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:30 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:31.053361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd178332-55c1-4e31-93a2-69ae995161ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:31.054699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd178332-55c1-4e31-93a2-69ae995161ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:31.061423 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd178332-55c1-4e31-93a2-69ae995161ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:31.061876 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd178332-55c1-4e31-93a2-69ae995161ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:31.062741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd178332-55c1-4e31-93a2-69ae995161ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:31.063180 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd178332-55c1-4e31-93a2-69ae995161ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:31.082326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:31.195715 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd178332-55c1-4e31-93a2-69ae995161ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:31.203578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd178332-55c1-4e31-93a2-69ae995161ab tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.154489 May 26 13:45:31.204154 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 50/109] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:31 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:31.255327 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:31.255933 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:31.262416 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:31.262929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:31.263691 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:31.264132 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:31.340260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-11e924b3-e0c7-4326-99a0-dc9e91c72cbc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:31.341025 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-11e924b3-e0c7-4326-99a0-dc9e91c72cbc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:31.348556 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11e924b3-e0c7-4326-99a0-dc9e91c72cbc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:31.349253 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11e924b3-e0c7-4326-99a0-dc9e91c72cbc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:31.350675 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11e924b3-e0c7-4326-99a0-dc9e91c72cbc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:31.351386 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11e924b3-e0c7-4326-99a0-dc9e91c72cbc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:31.401764 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:31.410376 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:31.411896 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:31.413012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-54e05221-8dcc-4f29-9d81-6f9e343ab0f8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.161625 May 26 13:45:31.413655 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 60/110] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:31 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:31.418215 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-11e924b3-e0c7-4326-99a0-dc9e91c72cbc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:31.425770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-11e924b3-e0c7-4326-99a0-dc9e91c72cbc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.089360 May 26 13:45:31.426481 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 51/111] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:31 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:31.544532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2703dc46-8317-4250-8ba2-ff54611a5146 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:31.545145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2703dc46-8317-4250-8ba2-ff54611a5146 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:31.551251 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2703dc46-8317-4250-8ba2-ff54611a5146 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:31.551703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2703dc46-8317-4250-8ba2-ff54611a5146 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:31.552514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2703dc46-8317-4250-8ba2-ff54611a5146 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:31.552951 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2703dc46-8317-4250-8ba2-ff54611a5146 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:31.612478 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2703dc46-8317-4250-8ba2-ff54611a5146 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:31.621571 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2703dc46-8317-4250-8ba2-ff54611a5146 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1271 microversion: 2.1 time: 0.080552 May 26 13:45:31.622665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 61/112] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:31 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:32.221077 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7e459330-6503-4a27-be76-fbf2c3bed745 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:32.221693 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7e459330-6503-4a27-be76-fbf2c3bed745 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:32.228575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e459330-6503-4a27-be76-fbf2c3bed745 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:32.229031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e459330-6503-4a27-be76-fbf2c3bed745 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:32.229811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e459330-6503-4a27-be76-fbf2c3bed745 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:32.230249 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7e459330-6503-4a27-be76-fbf2c3bed745 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:32.383242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7e459330-6503-4a27-be76-fbf2c3bed745 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:32.391382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7e459330-6503-4a27-be76-fbf2c3bed745 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.174347 May 26 13:45:32.391960 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 52/113] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:32 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:32.432385 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:32.432989 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:32.439590 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:32.440054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:32.440955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:32.441585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:32.442930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d60907a-dd6c-4c95-9fca-29ac9d087960 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:32.443566 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d60907a-dd6c-4c95-9fca-29ac9d087960 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:32.450833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d60907a-dd6c-4c95-9fca-29ac9d087960 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:32.451286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d60907a-dd6c-4c95-9fca-29ac9d087960 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:32.452382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d60907a-dd6c-4c95-9fca-29ac9d087960 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:32.452995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d60907a-dd6c-4c95-9fca-29ac9d087960 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:32.530705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9d60907a-dd6c-4c95-9fca-29ac9d087960 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:32.541830 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d60907a-dd6c-4c95-9fca-29ac9d087960 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1288 microversion: 2.1 time: 0.103210 May 26 13:45:32.543083 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 53/114] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:32 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1288 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:32.625623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1625437494", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "networks": [{"uuid": "ed6e76ad-8a60-4553-9a4f-125f6a59cade"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:32.704678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] validate_networks() for [('ed6e76ad-8a60-4553-9a4f-125f6a59cade', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:45:32.931235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:32.943774 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:32.947203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:32.952798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ec7449a7-24ff-4ddf-b522-a5904205327e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.521880 May 26 13:45:32.953450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 62/115] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:32 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:32.962209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0c1a65ca-ef8e-42d7-aac7-8d94ac3e3698 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:32.962769 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0c1a65ca-ef8e-42d7-aac7-8d94ac3e3698 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:32.979652 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c1a65ca-ef8e-42d7-aac7-8d94ac3e3698 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:32.980111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c1a65ca-ef8e-42d7-aac7-8d94ac3e3698 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:32.980928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c1a65ca-ef8e-42d7-aac7-8d94ac3e3698 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:32.981369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c1a65ca-ef8e-42d7-aac7-8d94ac3e3698 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:33.046914 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0c1a65ca-ef8e-42d7-aac7-8d94ac3e3698 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:33.057061 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0c1a65ca-ef8e-42d7-aac7-8d94ac3e3698 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1277 microversion: 2.1 time: 0.099403 May 26 13:45:33.067833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 63/116] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:32 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1277 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:33.412781 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-182b6b07-db07-4cdf-b734-f871e37c5dca tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:33.414149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-182b6b07-db07-4cdf-b734-f871e37c5dca tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:33.425382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:33.434930 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-182b6b07-db07-4cdf-b734-f871e37c5dca tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:33.437281 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-182b6b07-db07-4cdf-b734-f871e37c5dca tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:33.441397 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-182b6b07-db07-4cdf-b734-f871e37c5dca tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:33.444185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-182b6b07-db07-4cdf-b734-f871e37c5dca tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:33.838479 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-182b6b07-db07-4cdf-b734-f871e37c5dca tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:33.849480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-182b6b07-db07-4cdf-b734-f871e37c5dca tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.440816 May 26 13:45:33.851323 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 64/117] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:33 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:33.874571 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-61891f32-9159-4ec9-8ca2-8ea298324749 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:33.875390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-61891f32-9159-4ec9-8ca2-8ea298324749 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:33.889308 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-61891f32-9159-4ec9-8ca2-8ea298324749 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:33.890031 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-61891f32-9159-4ec9-8ca2-8ea298324749 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:33.892371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-61891f32-9159-4ec9-8ca2-8ea298324749 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:33.894517 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-61891f32-9159-4ec9-8ca2-8ea298324749 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.049110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-61891f32-9159-4ec9-8ca2-8ea298324749 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:34.059967 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-61891f32-9159-4ec9-8ca2-8ea298324749 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1294 microversion: 2.1 time: 0.196124 May 26 13:45:34.067455 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 65/118] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:33 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1294 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:34.073110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-c450a31f-e133-4267-ab2f-d616b0898297 req-14ae23ba-df3a-4492-bd0c-8be3b538d580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef326f08-0e4f-4ad0-9f62-f4197ccf5b65", "name": "network-vif-plugged", "status": "completed", "tag": "914816b6-d98c-46f8-9da7-123cb0956236"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:34.087487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-c450a31f-e133-4267-ab2f-d616b0898297 req-14ae23ba-df3a-4492-bd0c-8be3b538d580 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.087754 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-c450a31f-e133-4267-ab2f-d616b0898297 req-14ae23ba-df3a-4492-bd0c-8be3b538d580 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.102786 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-c450a31f-e133-4267-ab2f-d616b0898297 req-14ae23ba-df3a-4492-bd0c-8be3b538d580 service nova] Creating event network-vif-plugged:914816b6-d98c-46f8-9da7-123cb0956236 for instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 on hv-cinder-81966 May 26 13:45:34.108184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-c450a31f-e133-4267-ab2f-d616b0898297 req-14ae23ba-df3a-4492-bd0c-8be3b538d580 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039464 May 26 13:45:34.108998 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 66/119] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:34.121348 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:34.122365 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:34.129503 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.130175 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.131106 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.131676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.237794 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:45:34.239022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:45:34.239559 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:45:34.239974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:45:34.240408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:45:34.262556 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.263125 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.264008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.264675 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.290151 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:34.299353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:34.307717 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:34.309232 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:34.310375 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5baadc73-8bd6-47f0-9ffb-80591f1e5db8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.195771 May 26 13:45:34.311081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Getting quotas for project c879e95c508f401fbc77e63b1e64dd16. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:45:34.314328 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 67/120] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:34 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:34.320501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1f81dea1-be3f-4845-8ced-ecc3ebf4d292 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:34.321295 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1f81dea1-be3f-4845-8ced-ecc3ebf4d292 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:34.323835 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Getting quotas for user 6f7edee75b2845e6bbfbc64574691fb0 and project c879e95c508f401fbc77e63b1e64dd16. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:45:34.328572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f81dea1-be3f-4845-8ced-ecc3ebf4d292 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.329073 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f81dea1-be3f-4845-8ced-ecc3ebf4d292 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.330074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f81dea1-be3f-4845-8ced-ecc3ebf4d292 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.330701 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f81dea1-be3f-4845-8ced-ecc3ebf4d292 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.354908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:45:34.359451 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:45:34.421040 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1f81dea1-be3f-4845-8ced-ecc3ebf4d292 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:34.434234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1f81dea1-be3f-4845-8ced-ecc3ebf4d292 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1277 microversion: 2.1 time: 0.117526 May 26 13:45:34.436208 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9182884f-9510-4453-bc58-a811f8c86063 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.814657 May 26 13:45:34.438309 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 54/121] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:45:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:45:34.444509 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 68/122] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:34 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:34.453997 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ed04e1ee-f359-43ea-9b5a-2ea6d8ff4951 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:34.455020 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ed04e1ee-f359-43ea-9b5a-2ea6d8ff4951 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:34.611813 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ed04e1ee-f359-43ea-9b5a-2ea6d8ff4951 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:34.628956 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ed04e1ee-f359-43ea-9b5a-2ea6d8ff4951 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1214 microversion: 2.1 time: 0.183820 May 26 13:45:34.630178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 55/123] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:34 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1214 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:34.867401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4ba491f1-4780-4ddb-9d27-5ba880fc0bb5 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:34.868003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4ba491f1-4780-4ddb-9d27-5ba880fc0bb5 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:34.874117 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4ba491f1-4780-4ddb-9d27-5ba880fc0bb5 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.874559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4ba491f1-4780-4ddb-9d27-5ba880fc0bb5 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:34.875462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4ba491f1-4780-4ddb-9d27-5ba880fc0bb5 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:34.875968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4ba491f1-4780-4ddb-9d27-5ba880fc0bb5 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.020430 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4ba491f1-4780-4ddb-9d27-5ba880fc0bb5 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:35.028830 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4ba491f1-4780-4ddb-9d27-5ba880fc0bb5 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.165397 May 26 13:45:35.029413 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 69/124] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:34 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:35.090023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ca7eb445-c5f2-4da4-806f-788491b8de05 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:35.090626 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ca7eb445-c5f2-4da4-806f-788491b8de05 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:35.097919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca7eb445-c5f2-4da4-806f-788491b8de05 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:35.098466 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca7eb445-c5f2-4da4-806f-788491b8de05 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.099257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca7eb445-c5f2-4da4-806f-788491b8de05 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:35.099690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ca7eb445-c5f2-4da4-806f-788491b8de05 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.228902 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ca7eb445-c5f2-4da4-806f-788491b8de05 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:35.237882 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ca7eb445-c5f2-4da4-806f-788491b8de05 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1294 microversion: 2.1 time: 0.152662 May 26 13:45:35.239697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 56/125] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:35 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1294 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:35.333524 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:35.334158 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:35.344572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:35.345581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.346581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:35.347654 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.452610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-557efc10-4552-4809-aa24-67246cfc3e61 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:35.453218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-557efc10-4552-4809-aa24-67246cfc3e61 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:35.472054 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-557efc10-4552-4809-aa24-67246cfc3e61 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:35.483984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-557efc10-4552-4809-aa24-67246cfc3e61 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.485147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-557efc10-4552-4809-aa24-67246cfc3e61 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:35.485741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-557efc10-4552-4809-aa24-67246cfc3e61 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.645491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:35.667282 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:35.669255 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:35.670735 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2c6fc65a-2fc1-4ccd-ad6b-892e720aea8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.344447 May 26 13:45:35.673019 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 70/126] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:35 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:35.683973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b1d8f1ad-268e-48ba-b537-d7ccedc71346 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:35.687780 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b1d8f1ad-268e-48ba-b537-d7ccedc71346 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:35.695670 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1d8f1ad-268e-48ba-b537-d7ccedc71346 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:35.696398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1d8f1ad-268e-48ba-b537-d7ccedc71346 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.697534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1d8f1ad-268e-48ba-b537-d7ccedc71346 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:35.698366 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1d8f1ad-268e-48ba-b537-d7ccedc71346 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:35.729232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-557efc10-4552-4809-aa24-67246cfc3e61 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:35.755841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-557efc10-4552-4809-aa24-67246cfc3e61 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.307764 May 26 13:45:35.757210 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 57/127] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:35 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:35.954883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b1d8f1ad-268e-48ba-b537-d7ccedc71346 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:35.968271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b1d8f1ad-268e-48ba-b537-d7ccedc71346 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1218 microversion: 2.1 time: 0.293518 May 26 13:45:35.969372 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 71/128] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:35 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1218 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:36.046201 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5bbc782f-8234-4fec-9ba9-49cc72f4e416 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:36.047150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5bbc782f-8234-4fec-9ba9-49cc72f4e416 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:36.055285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bbc782f-8234-4fec-9ba9-49cc72f4e416 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.056420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bbc782f-8234-4fec-9ba9-49cc72f4e416 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.057224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bbc782f-8234-4fec-9ba9-49cc72f4e416 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.057653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5bbc782f-8234-4fec-9ba9-49cc72f4e416 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.255597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5bbc782f-8234-4fec-9ba9-49cc72f4e416 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:36.256728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6aad2964-342d-40a8-b73c-cc4371ae993c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:36.257755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6aad2964-342d-40a8-b73c-cc4371ae993c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:36.265271 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5bbc782f-8234-4fec-9ba9-49cc72f4e416 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.223373 May 26 13:45:36.265692 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6aad2964-342d-40a8-b73c-cc4371ae993c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.266140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6aad2964-342d-40a8-b73c-cc4371ae993c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.266289 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 58/129] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:36 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:36.270487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6aad2964-342d-40a8-b73c-cc4371ae993c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.271902 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6aad2964-342d-40a8-b73c-cc4371ae993c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.463733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6aad2964-342d-40a8-b73c-cc4371ae993c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:36.472258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6aad2964-342d-40a8-b73c-cc4371ae993c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.220742 May 26 13:45:36.472860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 72/130] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:36 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:36.692720 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:36.694142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:36.706230 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.706911 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.708076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.708829 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.774853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f2be8378-4152-453b-8841-2f7779b5053a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:36.775711 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f2be8378-4152-453b-8841-2f7779b5053a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:36.782439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f2be8378-4152-453b-8841-2f7779b5053a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.782888 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f2be8378-4152-453b-8841-2f7779b5053a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.783666 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f2be8378-4152-453b-8841-2f7779b5053a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.784107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f2be8378-4152-453b-8841-2f7779b5053a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.938597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:36.949821 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:36.954105 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f2be8378-4152-453b-8841-2f7779b5053a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:36.959482 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:36.961283 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-240f3b91-16cc-433e-8665-712f21e733d8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.274549 May 26 13:45:36.962129 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 59/131] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:36 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:36.962911 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f2be8378-4152-453b-8841-2f7779b5053a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.192426 May 26 13:45:36.963650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 73/132] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:36 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:36.985668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-18cf758c-6ae3-421e-8520-e5ddb11aeb04 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:36.986337 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-18cf758c-6ae3-421e-8520-e5ddb11aeb04 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:36.993381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18cf758c-6ae3-421e-8520-e5ddb11aeb04 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.993826 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18cf758c-6ae3-421e-8520-e5ddb11aeb04 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:36.994582 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18cf758c-6ae3-421e-8520-e5ddb11aeb04 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:36.995010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-18cf758c-6ae3-421e-8520-e5ddb11aeb04 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:37.074667 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-18cf758c-6ae3-421e-8520-e5ddb11aeb04 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:37.082894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-18cf758c-6ae3-421e-8520-e5ddb11aeb04 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1218 microversion: 2.1 time: 0.100890 May 26 13:45:37.084081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 60/133] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:36 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:37.282040 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6b8f610e-17ff-454e-b196-6215ad3189df tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:37.282652 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6b8f610e-17ff-454e-b196-6215ad3189df tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:37.289407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6b8f610e-17ff-454e-b196-6215ad3189df tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:37.290182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6b8f610e-17ff-454e-b196-6215ad3189df tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:37.291200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6b8f610e-17ff-454e-b196-6215ad3189df tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:37.291622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6b8f610e-17ff-454e-b196-6215ad3189df tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:37.446477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6b8f610e-17ff-454e-b196-6215ad3189df tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:37.455404 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6b8f610e-17ff-454e-b196-6215ad3189df tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.177151 May 26 13:45:37.456506 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 74/134] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:37 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:37.496458 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a16bf84-b5df-4d83-9db6-60093a39d823 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:37.497367 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a16bf84-b5df-4d83-9db6-60093a39d823 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:37.504033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a16bf84-b5df-4d83-9db6-60093a39d823 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:37.504522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a16bf84-b5df-4d83-9db6-60093a39d823 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:37.505288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a16bf84-b5df-4d83-9db6-60093a39d823 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:37.505717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a16bf84-b5df-4d83-9db6-60093a39d823 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:37.661162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6a16bf84-b5df-4d83-9db6-60093a39d823 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:37.669136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a16bf84-b5df-4d83-9db6-60093a39d823 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.177920 May 26 13:45:37.670178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 61/135] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:37 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:37.979856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:37.980812 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:37.981670 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9a844c3f-02a1-4513-a0c3-b6c8ee29025b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:37.982520 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9a844c3f-02a1-4513-a0c3-b6c8ee29025b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:37.988247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:37.988866 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:37.989877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:37.990499 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:37.992085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a844c3f-02a1-4513-a0c3-b6c8ee29025b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:37.992997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a844c3f-02a1-4513-a0c3-b6c8ee29025b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:37.993878 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a844c3f-02a1-4513-a0c3-b6c8ee29025b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:37.994320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a844c3f-02a1-4513-a0c3-b6c8ee29025b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:38.020586 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:38.148613 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:38.159128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:38.161404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:38.162850 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b93e0bb8-afec-4b0f-9856-fc346e511014 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.187377 May 26 13:45:38.163533 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9a844c3f-02a1-4513-a0c3-b6c8ee29025b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:38.164270 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 62/136] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:37 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:38.170389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f885d205-72f6-4eb2-b0d6-0129063717f8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:38.171250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f885d205-72f6-4eb2-b0d6-0129063717f8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:38.171824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9a844c3f-02a1-4513-a0c3-b6c8ee29025b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.195885 May 26 13:45:38.181239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 75/137] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:37 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:38.187387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f885d205-72f6-4eb2-b0d6-0129063717f8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:38.187959 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f885d205-72f6-4eb2-b0d6-0129063717f8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:38.188745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f885d205-72f6-4eb2-b0d6-0129063717f8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:38.189180 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f885d205-72f6-4eb2-b0d6-0129063717f8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:38.258869 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f885d205-72f6-4eb2-b0d6-0129063717f8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:38.268003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f885d205-72f6-4eb2-b0d6-0129063717f8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1218 microversion: 2.1 time: 0.101846 May 26 13:45:38.269311 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 63/138] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:38 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:38.474054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8fea09f4-d406-4449-a20b-9d46613438be tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:38.474716 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8fea09f4-d406-4449-a20b-9d46613438be tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:38.491942 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8fea09f4-d406-4449-a20b-9d46613438be tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:38.493451 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8fea09f4-d406-4449-a20b-9d46613438be tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:38.494730 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8fea09f4-d406-4449-a20b-9d46613438be tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:38.495402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8fea09f4-d406-4449-a20b-9d46613438be tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:38.687079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b2190ba4-9bd6-47e9-866c-e6ccabb7e007 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:38.687686 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b2190ba4-9bd6-47e9-866c-e6ccabb7e007 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:38.696120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2190ba4-9bd6-47e9-866c-e6ccabb7e007 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:38.702047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2190ba4-9bd6-47e9-866c-e6ccabb7e007 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:38.703101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2190ba4-9bd6-47e9-866c-e6ccabb7e007 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:38.703832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2190ba4-9bd6-47e9-866c-e6ccabb7e007 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:38.739742 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8fea09f4-d406-4449-a20b-9d46613438be tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:38.748662 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8fea09f4-d406-4449-a20b-9d46613438be tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.279368 May 26 13:45:38.749735 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 76/139] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:38 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:39.094318 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b2190ba4-9bd6-47e9-866c-e6ccabb7e007 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:39.123488 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b2190ba4-9bd6-47e9-866c-e6ccabb7e007 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.440547 May 26 13:45:39.125812 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 64/140] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:38 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:39.182805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:39.188340 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a69c3265-9864-4a27-8115-9904ea6f21f0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:39.189082 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a69c3265-9864-4a27-8115-9904ea6f21f0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:39.192366 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:39.196430 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a69c3265-9864-4a27-8115-9904ea6f21f0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:39.201089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:39.201864 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a69c3265-9864-4a27-8115-9904ea6f21f0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:39.202310 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:39.203277 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:39.203933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a69c3265-9864-4a27-8115-9904ea6f21f0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:39.204791 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a69c3265-9864-4a27-8115-9904ea6f21f0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:39.205626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:39.441395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:39.455516 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:39.457821 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:39.458946 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e4a71725-149b-4364-a30c-6d683af5c5b6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.281048 May 26 13:45:39.460694 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 77/141] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:39 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:39.466536 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9718f8ae-603b-48d3-97ee-0f240b4d132a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:39.467331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9718f8ae-603b-48d3-97ee-0f240b4d132a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:39.474945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9718f8ae-603b-48d3-97ee-0f240b4d132a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:39.476409 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9718f8ae-603b-48d3-97ee-0f240b4d132a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:39.477653 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9718f8ae-603b-48d3-97ee-0f240b4d132a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:39.478245 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9718f8ae-603b-48d3-97ee-0f240b4d132a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:39.559421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a69c3265-9864-4a27-8115-9904ea6f21f0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:39.570807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9718f8ae-603b-48d3-97ee-0f240b4d132a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:39.575325 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a69c3265-9864-4a27-8115-9904ea6f21f0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.387037 May 26 13:45:39.575984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 65/142] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:39 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:39.582052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9718f8ae-603b-48d3-97ee-0f240b4d132a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1210 microversion: 2.1 time: 0.120085 May 26 13:45:39.583198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 78/143] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:39 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1210 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:39.766572 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5e126f14-a420-4f92-ac49-cf3fad62bbb9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:39.767186 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5e126f14-a420-4f92-ac49-cf3fad62bbb9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:39.789830 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e126f14-a420-4f92-ac49-cf3fad62bbb9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:39.790549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e126f14-a420-4f92-ac49-cf3fad62bbb9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:39.791930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e126f14-a420-4f92-ac49-cf3fad62bbb9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:39.792554 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e126f14-a420-4f92-ac49-cf3fad62bbb9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.141795 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-62088070-9e69-4693-a443-f8f4d9d6cf14 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:40.142498 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-62088070-9e69-4693-a443-f8f4d9d6cf14 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:40.164254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-62088070-9e69-4693-a443-f8f4d9d6cf14 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.164800 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-62088070-9e69-4693-a443-f8f4d9d6cf14 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.166347 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-62088070-9e69-4693-a443-f8f4d9d6cf14 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.172982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-62088070-9e69-4693-a443-f8f4d9d6cf14 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.316578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e126f14-a420-4f92-ac49-cf3fad62bbb9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:40.329501 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5e126f14-a420-4f92-ac49-cf3fad62bbb9 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.566300 May 26 13:45:40.332041 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 66/144] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:39 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:40.479101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:40.479717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:40.486267 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.487032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.488586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.489214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.494697 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-62088070-9e69-4693-a443-f8f4d9d6cf14 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:40.504540 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-62088070-9e69-4693-a443-f8f4d9d6cf14 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.366677 May 26 13:45:40.505976 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 79/145] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:40 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:40.521856 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-12b0407b-6548-4b08-ac36-ea857843e60a req-8512995e-4120-4b33-be52-0118747a8138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b45620-7dd5-4bb5-9da2-e48381d78256", "tag": "fa68ed54-b95b-4bfd-afca-997df1610ee7"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:40.543025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-12b0407b-6548-4b08-ac36-ea857843e60a req-8512995e-4120-4b33-be52-0118747a8138 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.544157 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-12b0407b-6548-4b08-ac36-ea857843e60a req-8512995e-4120-4b33-be52-0118747a8138 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.561094 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-12b0407b-6548-4b08-ac36-ea857843e60a req-8512995e-4120-4b33-be52-0118747a8138 service nova] Creating event network-changed:fa68ed54-b95b-4bfd-afca-997df1610ee7 for instance 84b45620-7dd5-4bb5-9da2-e48381d78256 on hv-cinder-81966 May 26 13:45:40.568013 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-12b0407b-6548-4b08-ac36-ea857843e60a req-8512995e-4120-4b33-be52-0118747a8138 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054101 May 26 13:45:40.569086 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 80/146] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:40.602951 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c404a1c5-7a12-4468-9140-aa5668e0f7fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:40.605436 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c404a1c5-7a12-4468-9140-aa5668e0f7fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:40.617401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c404a1c5-7a12-4468-9140-aa5668e0f7fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.617888 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c404a1c5-7a12-4468-9140-aa5668e0f7fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.618877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c404a1c5-7a12-4468-9140-aa5668e0f7fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.619509 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c404a1c5-7a12-4468-9140-aa5668e0f7fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.821349 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:40.821882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c404a1c5-7a12-4468-9140-aa5668e0f7fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:40.830926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c404a1c5-7a12-4468-9140-aa5668e0f7fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.241863 May 26 13:45:40.831601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 81/147] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:40 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:40.840179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:40.844537 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-331b56dc-fb66-416a-ba5c-529e6ad918fb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:40.845438 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-331b56dc-fb66-416a-ba5c-529e6ad918fb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:40.848582 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:40.850072 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-96a68631-9818-47a3-93a2-62cbab876124 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.375449 May 26 13:45:40.861593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-331b56dc-fb66-416a-ba5c-529e6ad918fb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.862048 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-331b56dc-fb66-416a-ba5c-529e6ad918fb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.862445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 67/148] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:40 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:45:40.862846 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-331b56dc-fb66-416a-ba5c-529e6ad918fb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:40.863528 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-331b56dc-fb66-416a-ba5c-529e6ad918fb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:40.971417 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-331b56dc-fb66-416a-ba5c-529e6ad918fb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:40.980359 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-331b56dc-fb66-416a-ba5c-529e6ad918fb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1210 microversion: 2.1 time: 0.145944 May 26 13:45:40.981209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 82/149] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:40 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:41.353846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c7066060-e848-4493-913a-2c96cc2d4200 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:41.354471 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c7066060-e848-4493-913a-2c96cc2d4200 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:41.363266 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7066060-e848-4493-913a-2c96cc2d4200 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:41.366958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7066060-e848-4493-913a-2c96cc2d4200 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:41.369709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7066060-e848-4493-913a-2c96cc2d4200 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:41.370450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7066060-e848-4493-913a-2c96cc2d4200 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:41.523993 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7e800eb2-ac48-4147-9ff5-0b903dd786db tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:41.525658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7e800eb2-ac48-4147-9ff5-0b903dd786db tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:41.533729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e800eb2-ac48-4147-9ff5-0b903dd786db tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:41.534233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e800eb2-ac48-4147-9ff5-0b903dd786db tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:41.535379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e800eb2-ac48-4147-9ff5-0b903dd786db tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:41.536334 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e800eb2-ac48-4147-9ff5-0b903dd786db tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:41.575819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c7066060-e848-4493-913a-2c96cc2d4200 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:41.579303 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:41.589390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c7066060-e848-4493-913a-2c96cc2d4200 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1314 microversion: 2.1 time: 0.245519 May 26 13:45:41.590008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 68/150] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:41 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:41.762935 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7e800eb2-ac48-4147-9ff5-0b903dd786db tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:41.781170 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7e800eb2-ac48-4147-9ff5-0b903dd786db tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.261009 May 26 13:45:41.781808 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 83/151] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:41 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:41.852612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-af67f8ad-3def-4a90-b203-932b005ec928 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:41.853175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-af67f8ad-3def-4a90-b203-932b005ec928 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:41.862740 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af67f8ad-3def-4a90-b203-932b005ec928 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:41.863425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af67f8ad-3def-4a90-b203-932b005ec928 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:41.864643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af67f8ad-3def-4a90-b203-932b005ec928 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:41.865229 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af67f8ad-3def-4a90-b203-932b005ec928 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:41.872134 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:41.873499 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:41.887589 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:41.888256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:41.889401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:41.890440 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:42.045736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-af67f8ad-3def-4a90-b203-932b005ec928 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:42.049734 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:42.054118 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-af67f8ad-3def-4a90-b203-932b005ec928 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.207901 May 26 13:45:42.055416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 69/152] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:41 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:42.057886 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:42.059388 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:42.060542 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-24f80ca5-e368-4471-b519-1d828e466bfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.194874 May 26 13:45:42.061086 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 84/153] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:41 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:45:42.067508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0bcc483b-ae13-4e01-adad-0cf7dc746cc4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:42.068111 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0bcc483b-ae13-4e01-adad-0cf7dc746cc4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:42.074651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bcc483b-ae13-4e01-adad-0cf7dc746cc4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:42.075095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bcc483b-ae13-4e01-adad-0cf7dc746cc4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:42.075857 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bcc483b-ae13-4e01-adad-0cf7dc746cc4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:42.076286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bcc483b-ae13-4e01-adad-0cf7dc746cc4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:42.137637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0bcc483b-ae13-4e01-adad-0cf7dc746cc4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:42.145036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0bcc483b-ae13-4e01-adad-0cf7dc746cc4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1210 microversion: 2.1 time: 0.088452 May 26 13:45:42.145597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 70/154] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:42 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:42.607077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-fafe4b6c-8ba4-403f-8f77-4f6140ee2d53 req-593c42df-9ece-48ab-b211-6984c6f94a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b75f8bc8-637f-444e-b3f2-5f5fa9620cf9", "tag": "22ba30dc-f3ef-4d8d-aa67-0fbf99c6a3aa"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:42.607583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-287152f6-99ce-459b-81d0-86ca7a098372 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:42.607977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-287152f6-99ce-459b-81d0-86ca7a098372 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:42.614115 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-287152f6-99ce-459b-81d0-86ca7a098372 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:42.614555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-287152f6-99ce-459b-81d0-86ca7a098372 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:42.615315 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-287152f6-99ce-459b-81d0-86ca7a098372 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:42.615461 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-fafe4b6c-8ba4-403f-8f77-4f6140ee2d53 req-593c42df-9ece-48ab-b211-6984c6f94a68 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:42.615780 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-287152f6-99ce-459b-81d0-86ca7a098372 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:42.616484 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-fafe4b6c-8ba4-403f-8f77-4f6140ee2d53 req-593c42df-9ece-48ab-b211-6984c6f94a68 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:42.628014 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-fafe4b6c-8ba4-403f-8f77-4f6140ee2d53 req-593c42df-9ece-48ab-b211-6984c6f94a68 service nova] Creating event network-changed:22ba30dc-f3ef-4d8d-aa67-0fbf99c6a3aa for instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 on hv-cinder-81966 May 26 13:45:42.634131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-fafe4b6c-8ba4-403f-8f77-4f6140ee2d53 req-593c42df-9ece-48ab-b211-6984c6f94a68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031177 May 26 13:45:42.635153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 85/155] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:42.754623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-287152f6-99ce-459b-81d0-86ca7a098372 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:42.762308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-287152f6-99ce-459b-81d0-86ca7a098372 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1501 microversion: 2.1 time: 0.158792 May 26 13:45:42.762881 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 71/156] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:42 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:42.798465 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-074ecd57-23be-4738-a490-540529879510 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:42.799365 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-074ecd57-23be-4738-a490-540529879510 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:42.806308 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-074ecd57-23be-4738-a490-540529879510 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:42.806939 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-074ecd57-23be-4738-a490-540529879510 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:42.807889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-074ecd57-23be-4738-a490-540529879510 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:42.808606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-074ecd57-23be-4738-a490-540529879510 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:42.969452 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-074ecd57-23be-4738-a490-540529879510 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:42.978933 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-074ecd57-23be-4738-a490-540529879510 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.184479 May 26 13:45:42.979706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 86/157] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:42 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:43.072524 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6818870c-1297-4bcd-a2dd-8ea9c08c9267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:43.073194 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6818870c-1297-4bcd-a2dd-8ea9c08c9267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:43.080832 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:43.082039 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:43.082435 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6818870c-1297-4bcd-a2dd-8ea9c08c9267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:43.085874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6818870c-1297-4bcd-a2dd-8ea9c08c9267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:43.088481 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6818870c-1297-4bcd-a2dd-8ea9c08c9267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:43.090512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6818870c-1297-4bcd-a2dd-8ea9c08c9267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:43.092522 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:43.093185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:43.094561 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:43.095184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:43.279611 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:43.286182 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6818870c-1297-4bcd-a2dd-8ea9c08c9267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:43.289421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:43.291699 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:43.292940 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7334db87-8781-46d6-b301-13bce629a493 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.217737 May 26 13:45:43.293588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 87/158] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:43 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:45:43.297499 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6818870c-1297-4bcd-a2dd-8ea9c08c9267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.230314 May 26 13:45:43.298012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4f0932a5-dd8b-47aa-a922-10fb05de55b7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:43.298659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 72/159] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:43 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:43.298776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4f0932a5-dd8b-47aa-a922-10fb05de55b7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:43.304732 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4f0932a5-dd8b-47aa-a922-10fb05de55b7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:43.305175 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4f0932a5-dd8b-47aa-a922-10fb05de55b7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:43.305937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4f0932a5-dd8b-47aa-a922-10fb05de55b7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:43.306375 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4f0932a5-dd8b-47aa-a922-10fb05de55b7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:43.372657 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4f0932a5-dd8b-47aa-a922-10fb05de55b7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:43.380089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4f0932a5-dd8b-47aa-a922-10fb05de55b7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1210 microversion: 2.1 time: 0.085558 May 26 13:45:43.380693 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 88/160] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:43 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:43.998795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f9952be9-d8e5-4434-94a6-2ddf750516f2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:43.999577 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f9952be9-d8e5-4434-94a6-2ddf750516f2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:44.006203 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9952be9-d8e5-4434-94a6-2ddf750516f2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:44.006697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9952be9-d8e5-4434-94a6-2ddf750516f2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:44.007631 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9952be9-d8e5-4434-94a6-2ddf750516f2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:44.008076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f9952be9-d8e5-4434-94a6-2ddf750516f2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:44.140916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f9952be9-d8e5-4434-94a6-2ddf750516f2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:44.149405 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f9952be9-d8e5-4434-94a6-2ddf750516f2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.156143 May 26 13:45:44.149992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 73/161] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:43 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:44.311210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:44.311817 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:44.314678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3788182d-eb47-459e-8551-c62af28fb07c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:44.315284 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3788182d-eb47-459e-8551-c62af28fb07c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:44.317141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:44.317924 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:44.318479 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:44.319324 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:44.319762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:44.322922 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3788182d-eb47-459e-8551-c62af28fb07c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:44.323365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3788182d-eb47-459e-8551-c62af28fb07c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:44.324131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3788182d-eb47-459e-8551-c62af28fb07c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:44.324585 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3788182d-eb47-459e-8551-c62af28fb07c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:44.452486 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:44.456682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3788182d-eb47-459e-8551-c62af28fb07c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:44.462096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:44.464968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:44.465115 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3788182d-eb47-459e-8551-c62af28fb07c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.154136 May 26 13:45:44.465550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 74/162] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:44 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:44.466940 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-570cc761-2c6c-4347-b367-d02f07a95f48 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.159409 May 26 13:45:44.467878 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 89/163] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:44 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:44.470350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-19021309-5bc4-4666-91d2-53e9c0b696dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:44.470946 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-19021309-5bc4-4666-91d2-53e9c0b696dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:44.477894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19021309-5bc4-4666-91d2-53e9c0b696dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:44.478335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19021309-5bc4-4666-91d2-53e9c0b696dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:44.479093 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19021309-5bc4-4666-91d2-53e9c0b696dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:44.479513 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-19021309-5bc4-4666-91d2-53e9c0b696dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:44.539167 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-19021309-5bc4-4666-91d2-53e9c0b696dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:44.546467 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-19021309-5bc4-4666-91d2-53e9c0b696dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1210 microversion: 2.1 time: 0.079816 May 26 13:45:44.547018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 75/164] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:44 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:45.166419 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ef360b17-c3d3-46f9-9eff-f9bddd4d0d1a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:45.166941 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ef360b17-c3d3-46f9-9eff-f9bddd4d0d1a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:45.173062 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ef360b17-c3d3-46f9-9eff-f9bddd4d0d1a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:45.173513 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ef360b17-c3d3-46f9-9eff-f9bddd4d0d1a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:45.174280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ef360b17-c3d3-46f9-9eff-f9bddd4d0d1a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:45.174710 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ef360b17-c3d3-46f9-9eff-f9bddd4d0d1a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:45.314374 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ef360b17-c3d3-46f9-9eff-f9bddd4d0d1a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:45.322562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ef360b17-c3d3-46f9-9eff-f9bddd4d0d1a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.160225 May 26 13:45:45.323398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 90/165] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:45 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:45.482082 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6d87d2ad-5666-4f66-803a-2835e0daa58b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:45.482710 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6d87d2ad-5666-4f66-803a-2835e0daa58b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:45.484678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=8 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:45.485247 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:45.485997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:45.490128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d87d2ad-5666-4f66-803a-2835e0daa58b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:45.491297 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d87d2ad-5666-4f66-803a-2835e0daa58b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:45.492050 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d87d2ad-5666-4f66-803a-2835e0daa58b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:45.492517 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6d87d2ad-5666-4f66-803a-2835e0daa58b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:45.493008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:45.493514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:45.494358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:45.494799 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:45.633418 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:45.638935 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6d87d2ad-5666-4f66-803a-2835e0daa58b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:45.641805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:45.643293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:45.644414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4d50c67e-fb73-4625-a266-001c9094cb51 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.163424 May 26 13:45:45.644971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 91/166] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:45 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:45:45.646717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6d87d2ad-5666-4f66-803a-2835e0daa58b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.168436 May 26 13:45:45.647811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 76/167] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:45 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:45.660374 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-88a44fca-7bfe-456e-b8cd-abbe353aca44 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:45.660973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-88a44fca-7bfe-456e-b8cd-abbe353aca44 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:45.667628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-88a44fca-7bfe-456e-b8cd-abbe353aca44 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:45.668064 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-88a44fca-7bfe-456e-b8cd-abbe353aca44 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:45.668836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-88a44fca-7bfe-456e-b8cd-abbe353aca44 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:45.669262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-88a44fca-7bfe-456e-b8cd-abbe353aca44 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:45.729251 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-88a44fca-7bfe-456e-b8cd-abbe353aca44 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:45.736741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-88a44fca-7bfe-456e-b8cd-abbe353aca44 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1210 microversion: 2.1 time: 0.079965 May 26 13:45:45.737307 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 92/168] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:45 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:46.340603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-16a08b62-a69c-4384-b36b-b19282ccdb51 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:46.341270 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-16a08b62-a69c-4384-b36b-b19282ccdb51 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:46.347400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16a08b62-a69c-4384-b36b-b19282ccdb51 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:46.347839 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16a08b62-a69c-4384-b36b-b19282ccdb51 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:46.348625 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16a08b62-a69c-4384-b36b-b19282ccdb51 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:46.349052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-16a08b62-a69c-4384-b36b-b19282ccdb51 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:46.482342 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-16a08b62-a69c-4384-b36b-b19282ccdb51 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:46.489839 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-16a08b62-a69c-4384-b36b-b19282ccdb51 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.153680 May 26 13:45:46.490405 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 77/169] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:46 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:46.662861 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-54453539-95fd-470a-b9cf-d102ca5fef34 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:46.663383 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:46.663907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-54453539-95fd-470a-b9cf-d102ca5fef34 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:46.664786 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:46.671732 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-54453539-95fd-470a-b9cf-d102ca5fef34 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:46.672031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:46.672841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:46.673330 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-54453539-95fd-470a-b9cf-d102ca5fef34 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:46.673977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:46.674555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:46.674837 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-54453539-95fd-470a-b9cf-d102ca5fef34 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:46.675599 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-54453539-95fd-470a-b9cf-d102ca5fef34 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:46.723456 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:46.874273 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-54453539-95fd-470a-b9cf-d102ca5fef34 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:46.882251 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-54453539-95fd-470a-b9cf-d102ca5fef34 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.223181 May 26 13:45:46.882838 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 93/170] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:46 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:46.887526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9b2507e9-bfb7-460b-a088-aa233f8bb8c6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:46.888134 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9b2507e9-bfb7-460b-a088-aa233f8bb8c6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:46.894669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b2507e9-bfb7-460b-a088-aa233f8bb8c6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:46.895118 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b2507e9-bfb7-460b-a088-aa233f8bb8c6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:46.895986 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b2507e9-bfb7-460b-a088-aa233f8bb8c6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:46.896378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b2507e9-bfb7-460b-a088-aa233f8bb8c6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:46.933219 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:46.941582 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:46.943131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:46.944617 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2a41d478-6265-45e0-a617-21dff3f132bb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.285545 May 26 13:45:46.945936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 78/171] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:46 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:46.965599 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9b2507e9-bfb7-460b-a088-aa233f8bb8c6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:46.973111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9b2507e9-bfb7-460b-a088-aa233f8bb8c6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1210 microversion: 2.1 time: 0.089323 May 26 13:45:46.973673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 94/172] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:46 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:47.508474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-02276c6f-24dc-4645-b4ad-90da680004af tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:47.509119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-02276c6f-24dc-4645-b4ad-90da680004af tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:47.515475 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02276c6f-24dc-4645-b4ad-90da680004af tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:47.515936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02276c6f-24dc-4645-b4ad-90da680004af tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:47.516716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02276c6f-24dc-4645-b4ad-90da680004af tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:47.517278 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-02276c6f-24dc-4645-b4ad-90da680004af tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:47.902123 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2ca29fe6-37c3-44c7-bbdb-f95629650183 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:47.902804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2ca29fe6-37c3-44c7-bbdb-f95629650183 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:47.910226 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2ca29fe6-37c3-44c7-bbdb-f95629650183 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:47.911026 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2ca29fe6-37c3-44c7-bbdb-f95629650183 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:47.912254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2ca29fe6-37c3-44c7-bbdb-f95629650183 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:47.913762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2ca29fe6-37c3-44c7-bbdb-f95629650183 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:48.036691 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-02276c6f-24dc-4645-b4ad-90da680004af tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:48.044575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-02276c6f-24dc-4645-b4ad-90da680004af tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.541734 May 26 13:45:48.045148 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 79/173] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:47 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:48.050045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:48.051143 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:48.058301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:48.058653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:48.059414 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:48.059836 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:48.061169 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2ca29fe6-37c3-44c7-bbdb-f95629650183 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:48.068869 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2ca29fe6-37c3-44c7-bbdb-f95629650183 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.173864 May 26 13:45:48.075704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 95/174] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:47 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:48.075704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-05e8892b-3be5-41dd-915c-3964050b5c65 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:48.075704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-05e8892b-3be5-41dd-915c-3964050b5c65 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:48.087582 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-05e8892b-3be5-41dd-915c-3964050b5c65 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:48.088045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-05e8892b-3be5-41dd-915c-3964050b5c65 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:48.088863 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-05e8892b-3be5-41dd-915c-3964050b5c65 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:48.089332 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-05e8892b-3be5-41dd-915c-3964050b5c65 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:48.153399 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-05e8892b-3be5-41dd-915c-3964050b5c65 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:48.161015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-05e8892b-3be5-41dd-915c-3964050b5c65 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1266 microversion: 2.1 time: 0.090060 May 26 13:45:48.161592 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 96/175] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:48 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:48.166945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-04ea95a5-f92b-4d42-b6a1-a9a05115d7a5 req-18a29520-a02a-49ab-9f27-87a767403a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6527206-c7a2-4458-97ed-915ee9b16cfb", "name": "network-vif-plugged", "status": "completed", "tag": "cbc63303-0423-4bdd-8895-788f378a4ced"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:48.175003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-04ea95a5-f92b-4d42-b6a1-a9a05115d7a5 req-18a29520-a02a-49ab-9f27-87a767403a40 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:48.175442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-04ea95a5-f92b-4d42-b6a1-a9a05115d7a5 req-18a29520-a02a-49ab-9f27-87a767403a40 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:48.186832 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-04ea95a5-f92b-4d42-b6a1-a9a05115d7a5 req-18a29520-a02a-49ab-9f27-87a767403a40 service nova] Creating event network-vif-plugged:cbc63303-0423-4bdd-8895-788f378a4ced for instance c6527206-c7a2-4458-97ed-915ee9b16cfb on hv-cinder-81966 May 26 13:45:48.191791 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-04ea95a5-f92b-4d42-b6a1-a9a05115d7a5 req-18a29520-a02a-49ab-9f27-87a767403a40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029096 May 26 13:45:48.192415 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 97/176] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:48.196696 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:48.205336 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:48.206838 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:48.207936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fe3d427d-e3ba-4755-bcb0-e7db8fd7ceae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1407 microversion: 2.20 time: 0.161718 May 26 13:45:48.208551 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 80/177] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:48 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:48.376081 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a0bfaf30-448f-401b-a093-c1461a290c22 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08c220de-fd9b-440e-b1a4-f09934d405d1"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:48.377249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a0bfaf30-448f-401b-a093-c1461a290c22 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:48.384898 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a0bfaf30-448f-401b-a093-c1461a290c22 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:48.385221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a0bfaf30-448f-401b-a093-c1461a290c22 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:48.385894 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a0bfaf30-448f-401b-a093-c1461a290c22 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:48.386324 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a0bfaf30-448f-401b-a093-c1461a290c22 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.062251 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7003784f-6fe8-4ce9-a968-d7090d1bfecb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:49.062844 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7003784f-6fe8-4ce9-a968-d7090d1bfecb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:49.069883 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7003784f-6fe8-4ce9-a968-d7090d1bfecb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.070503 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7003784f-6fe8-4ce9-a968-d7090d1bfecb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.071439 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7003784f-6fe8-4ce9-a968-d7090d1bfecb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.072050 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7003784f-6fe8-4ce9-a968-d7090d1bfecb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.223916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7003784f-6fe8-4ce9-a968-d7090d1bfecb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:49.232818 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7003784f-6fe8-4ce9-a968-d7090d1bfecb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.174237 May 26 13:45:49.233425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 81/178] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:49 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:49.238657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e008b1ca-4202-42ff-bc2f-d8b8f44ff4e2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:49.239517 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e008b1ca-4202-42ff-bc2f-d8b8f44ff4e2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:49.248378 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e008b1ca-4202-42ff-bc2f-d8b8f44ff4e2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.249495 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e008b1ca-4202-42ff-bc2f-d8b8f44ff4e2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.250850 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e008b1ca-4202-42ff-bc2f-d8b8f44ff4e2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.251485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e008b1ca-4202-42ff-bc2f-d8b8f44ff4e2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.406736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e008b1ca-4202-42ff-bc2f-d8b8f44ff4e2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:49.417217 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e008b1ca-4202-42ff-bc2f-d8b8f44ff4e2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.182381 May 26 13:45:49.417781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 82/179] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:49 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:49.424614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1a5a09a9-e60b-440e-8b0e-9d7ae82b18f2 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:49.425397 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1a5a09a9-e60b-440e-8b0e-9d7ae82b18f2 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:49.434086 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a5a09a9-e60b-440e-8b0e-9d7ae82b18f2 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.434679 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a5a09a9-e60b-440e-8b0e-9d7ae82b18f2 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.435526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a5a09a9-e60b-440e-8b0e-9d7ae82b18f2 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.435974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a5a09a9-e60b-440e-8b0e-9d7ae82b18f2 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.574902 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1a5a09a9-e60b-440e-8b0e-9d7ae82b18f2 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:49.582983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1a5a09a9-e60b-440e-8b0e-9d7ae82b18f2 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.163482 May 26 13:45:49.583546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 83/180] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:49 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:49.589363 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:49.589965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:49.595828 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.596415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.597143 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.597627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.736456 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:49.745916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:49.747804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:49.749140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc7702a4-44d6-4d58-8625-3ff0b28421ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1600 microversion: 2.20 time: 0.163820 May 26 13:45:49.750682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 84/181] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:45:49 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:45:49.767563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4e94c52a-ff25-4b91-9927-640e4e92ccfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:49.768053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4e94c52a-ff25-4b91-9927-640e4e92ccfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:49.774377 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e94c52a-ff25-4b91-9927-640e4e92ccfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.774824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e94c52a-ff25-4b91-9927-640e4e92ccfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.775579 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e94c52a-ff25-4b91-9927-640e4e92ccfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:49.776003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e94c52a-ff25-4b91-9927-640e4e92ccfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:49.826090 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:49.894602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4e94c52a-ff25-4b91-9927-640e4e92ccfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130772 May 26 13:45:49.895469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 85/182] 10.222.0.16 () {60 vars in 1315 bytes} [Thu May 26 13:45:49 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:45:50.251177 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3d32d513-5278-407b-b35f-2e4c0a66e7e5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:50.251818 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3d32d513-5278-407b-b35f-2e4c0a66e7e5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:50.260749 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d32d513-5278-407b-b35f-2e4c0a66e7e5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:50.261509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d32d513-5278-407b-b35f-2e4c0a66e7e5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:50.262556 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d32d513-5278-407b-b35f-2e4c0a66e7e5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:50.263204 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d32d513-5278-407b-b35f-2e4c0a66e7e5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:50.791147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3d32d513-5278-407b-b35f-2e4c0a66e7e5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:50.800294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3d32d513-5278-407b-b35f-2e4c0a66e7e5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.553168 May 26 13:45:50.813992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 86/183] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:50 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:50.819819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c323fe8a-5969-471e-bdfb-17ea437982e3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:50.820958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c323fe8a-5969-471e-bdfb-17ea437982e3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:50.829113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c323fe8a-5969-471e-bdfb-17ea437982e3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:50.829799 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c323fe8a-5969-471e-bdfb-17ea437982e3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:50.830796 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c323fe8a-5969-471e-bdfb-17ea437982e3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:50.831564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c323fe8a-5969-471e-bdfb-17ea437982e3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:51.223294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c323fe8a-5969-471e-bdfb-17ea437982e3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:51.231735 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c323fe8a-5969-471e-bdfb-17ea437982e3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.416548 May 26 13:45:51.232493 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 87/184] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:50 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:51.237130 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c782320d-5c56-4d96-a567-0bc2839443f1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:51.238109 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c782320d-5c56-4d96-a567-0bc2839443f1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:51.245323 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c782320d-5c56-4d96-a567-0bc2839443f1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:51.246021 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c782320d-5c56-4d96-a567-0bc2839443f1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:51.246789 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c782320d-5c56-4d96-a567-0bc2839443f1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:51.247219 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c782320d-5c56-4d96-a567-0bc2839443f1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:51.467209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c782320d-5c56-4d96-a567-0bc2839443f1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:51.475538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c782320d-5c56-4d96-a567-0bc2839443f1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.241273 May 26 13:45:51.485819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 88/185] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:51 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:51.587480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-a8e02696-d39f-499c-bbc7-448db3fe9367 req-1b80939e-f5c9-4bb5-af27-057d9eef4cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef326f08-0e4f-4ad0-9f62-f4197ccf5b65", "tag": "914816b6-d98c-46f8-9da7-123cb0956236"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:51.595522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-a8e02696-d39f-499c-bbc7-448db3fe9367 req-1b80939e-f5c9-4bb5-af27-057d9eef4cb1 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:51.595961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-a8e02696-d39f-499c-bbc7-448db3fe9367 req-1b80939e-f5c9-4bb5-af27-057d9eef4cb1 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:51.607957 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-a8e02696-d39f-499c-bbc7-448db3fe9367 req-1b80939e-f5c9-4bb5-af27-057d9eef4cb1 service nova] Creating event network-changed:914816b6-d98c-46f8-9da7-123cb0956236 for instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 on hv-cinder-81966 May 26 13:45:51.613234 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-a8e02696-d39f-499c-bbc7-448db3fe9367 req-1b80939e-f5c9-4bb5-af27-057d9eef4cb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029852 May 26 13:45:51.614376 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 89/186] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:51.824467 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-37c07b1f-7092-42aa-96ef-8b66304945d1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:51.825513 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-37c07b1f-7092-42aa-96ef-8b66304945d1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:51.831884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37c07b1f-7092-42aa-96ef-8b66304945d1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:51.832455 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37c07b1f-7092-42aa-96ef-8b66304945d1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:51.833323 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37c07b1f-7092-42aa-96ef-8b66304945d1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:51.833927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37c07b1f-7092-42aa-96ef-8b66304945d1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:51.997308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-37c07b1f-7092-42aa-96ef-8b66304945d1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:52.006864 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-37c07b1f-7092-42aa-96ef-8b66304945d1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.186722 May 26 13:45:52.008735 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 90/187] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:51 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:52.256663 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5300d6b2-8f41-4227-b215-8bf285bd7cea tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:52.256663 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5300d6b2-8f41-4227-b215-8bf285bd7cea tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:52.258060 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5300d6b2-8f41-4227-b215-8bf285bd7cea tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:52.258060 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5300d6b2-8f41-4227-b215-8bf285bd7cea tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:52.259705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5300d6b2-8f41-4227-b215-8bf285bd7cea tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:52.259705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5300d6b2-8f41-4227-b215-8bf285bd7cea tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:52.417634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5300d6b2-8f41-4227-b215-8bf285bd7cea tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:52.426967 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5300d6b2-8f41-4227-b215-8bf285bd7cea tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.181360 May 26 13:45:52.427730 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 91/188] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:52 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:52.493529 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fa153407-c355-4bbe-ba14-84d98c58e8a5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:52.494318 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fa153407-c355-4bbe-ba14-84d98c58e8a5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:52.500295 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa153407-c355-4bbe-ba14-84d98c58e8a5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:52.500923 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa153407-c355-4bbe-ba14-84d98c58e8a5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:52.501698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa153407-c355-4bbe-ba14-84d98c58e8a5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:52.502134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fa153407-c355-4bbe-ba14-84d98c58e8a5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:52.651821 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fa153407-c355-4bbe-ba14-84d98c58e8a5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:52.659723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fa153407-c355-4bbe-ba14-84d98c58e8a5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.170892 May 26 13:45:52.660531 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 92/189] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:52 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:53.035402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c96d07c7-2a92-4e22-ab7a-16d2008a5ae7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:53.035402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c96d07c7-2a92-4e22-ab7a-16d2008a5ae7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:53.035402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c96d07c7-2a92-4e22-ab7a-16d2008a5ae7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:53.035857 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c96d07c7-2a92-4e22-ab7a-16d2008a5ae7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:53.036467 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c96d07c7-2a92-4e22-ab7a-16d2008a5ae7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:53.037077 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c96d07c7-2a92-4e22-ab7a-16d2008a5ae7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:53.183621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c96d07c7-2a92-4e22-ab7a-16d2008a5ae7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:53.193064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c96d07c7-2a92-4e22-ab7a-16d2008a5ae7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.171833 May 26 13:45:53.194384 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 93/190] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:53 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:53.444408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-55c4efb9-4c20-48b8-afb5-ee569ddfb2a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:53.444988 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-55c4efb9-4c20-48b8-afb5-ee569ddfb2a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:53.451241 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55c4efb9-4c20-48b8-afb5-ee569ddfb2a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:53.451679 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55c4efb9-4c20-48b8-afb5-ee569ddfb2a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:53.452462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55c4efb9-4c20-48b8-afb5-ee569ddfb2a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:53.452891 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-55c4efb9-4c20-48b8-afb5-ee569ddfb2a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:53.601282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-55c4efb9-4c20-48b8-afb5-ee569ddfb2a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:53.610123 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-55c4efb9-4c20-48b8-afb5-ee569ddfb2a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.170119 May 26 13:45:53.611231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 94/191] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:53 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:53.677578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-655c3ab8-d4dc-476a-9904-aa9980ffa58c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:53.679395 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-655c3ab8-d4dc-476a-9904-aa9980ffa58c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:53.685438 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-655c3ab8-d4dc-476a-9904-aa9980ffa58c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:53.685884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-655c3ab8-d4dc-476a-9904-aa9980ffa58c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:53.686651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-655c3ab8-d4dc-476a-9904-aa9980ffa58c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:53.687083 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-655c3ab8-d4dc-476a-9904-aa9980ffa58c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:53.710954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a0bfaf30-448f-401b-a093-c1461a290c22 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "POST /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.338763 May 26 13:45:53.711519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 98/192] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:45:48 2022] POST /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63/os-volume_attachments => generated 194 bytes in 5341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:53.822232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-655c3ab8-d4dc-476a-9904-aa9980ffa58c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:53.830807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-655c3ab8-d4dc-476a-9904-aa9980ffa58c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.157267 May 26 13:45:53.831386 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 95/193] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:53 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:45:54.214891 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d41affa1-7cb1-4313-b104-fd207eefac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:54.215018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d41affa1-7cb1-4313-b104-fd207eefac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:54.221409 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d41affa1-7cb1-4313-b104-fd207eefac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:54.221856 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d41affa1-7cb1-4313-b104-fd207eefac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:54.222622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d41affa1-7cb1-4313-b104-fd207eefac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:54.223054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d41affa1-7cb1-4313-b104-fd207eefac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:54.414318 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d41affa1-7cb1-4313-b104-fd207eefac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:54.422006 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d41affa1-7cb1-4313-b104-fd207eefac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.214707 May 26 13:45:54.431853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 99/194] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:54 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:54.521328 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-69ce7608-ff47-46d5-a925-51d78eb4d81d req-0c17ad17-a6aa-4004-b1b2-528fca402d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1", "tag": "16b9a0f5-441f-49b0-90d7-fb4d546e3615"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:45:54.531063 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-69ce7608-ff47-46d5-a925-51d78eb4d81d req-0c17ad17-a6aa-4004-b1b2-528fca402d61 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:54.531600 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-69ce7608-ff47-46d5-a925-51d78eb4d81d req-0c17ad17-a6aa-4004-b1b2-528fca402d61 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:54.544993 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-69ce7608-ff47-46d5-a925-51d78eb4d81d req-0c17ad17-a6aa-4004-b1b2-528fca402d61 service nova] Creating event network-changed:16b9a0f5-441f-49b0-90d7-fb4d546e3615 for instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 on hv-cinder-81966 May 26 13:45:54.549835 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-69ce7608-ff47-46d5-a925-51d78eb4d81d req-0c17ad17-a6aa-4004-b1b2-528fca402d61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032682 May 26 13:45:54.550425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 96/195] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:45:54.627866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-17255d1a-e7da-451e-9434-ce899d90360a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:54.628748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-17255d1a-e7da-451e-9434-ce899d90360a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:54.636284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17255d1a-e7da-451e-9434-ce899d90360a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:54.636758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17255d1a-e7da-451e-9434-ce899d90360a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:54.637536 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17255d1a-e7da-451e-9434-ce899d90360a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:54.638603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17255d1a-e7da-451e-9434-ce899d90360a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:54.793081 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-17255d1a-e7da-451e-9434-ce899d90360a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:54.800467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-17255d1a-e7da-451e-9434-ce899d90360a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.177100 May 26 13:45:54.801041 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 100/196] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:54 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:54.848469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a38bc07f-f035-4ba0-a9bc-d8c85af64f52 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:54.849220 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a38bc07f-f035-4ba0-a9bc-d8c85af64f52 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:54.856038 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a38bc07f-f035-4ba0-a9bc-d8c85af64f52 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:54.856528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a38bc07f-f035-4ba0-a9bc-d8c85af64f52 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:54.857299 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a38bc07f-f035-4ba0-a9bc-d8c85af64f52 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:54.857744 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a38bc07f-f035-4ba0-a9bc-d8c85af64f52 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:54.997020 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a38bc07f-f035-4ba0-a9bc-d8c85af64f52 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:55.006657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a38bc07f-f035-4ba0-a9bc-d8c85af64f52 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.162290 May 26 13:45:55.007452 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 97/197] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:54 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:55.438965 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6aea0aba-2fba-4a7a-8df5-7da01ac44889 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:55.439757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6aea0aba-2fba-4a7a-8df5-7da01ac44889 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:55.446672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6aea0aba-2fba-4a7a-8df5-7da01ac44889 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:55.447128 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6aea0aba-2fba-4a7a-8df5-7da01ac44889 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:55.448151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6aea0aba-2fba-4a7a-8df5-7da01ac44889 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:55.448621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6aea0aba-2fba-4a7a-8df5-7da01ac44889 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:55.591308 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6aea0aba-2fba-4a7a-8df5-7da01ac44889 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:55.599085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6aea0aba-2fba-4a7a-8df5-7da01ac44889 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.163882 May 26 13:45:55.600283 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 101/198] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:55 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:55.817592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-86024a18-5d2c-4674-b50c-8896a417bad5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:55.818733 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-86024a18-5d2c-4674-b50c-8896a417bad5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:55.820818 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:45:55.826652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86024a18-5d2c-4674-b50c-8896a417bad5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:55.827104 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86024a18-5d2c-4674-b50c-8896a417bad5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:55.827879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86024a18-5d2c-4674-b50c-8896a417bad5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:55.828338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-86024a18-5d2c-4674-b50c-8896a417bad5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:55.985682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-86024a18-5d2c-4674-b50c-8896a417bad5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:55.996178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-86024a18-5d2c-4674-b50c-8896a417bad5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.182479 May 26 13:45:55.997629 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 98/199] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:55 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:56.023585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-87d4901c-8efb-41e3-adb6-50675aaa6b1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:56.024266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-87d4901c-8efb-41e3-adb6-50675aaa6b1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:56.030252 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-87d4901c-8efb-41e3-adb6-50675aaa6b1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:56.030728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-87d4901c-8efb-41e3-adb6-50675aaa6b1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:56.031547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-87d4901c-8efb-41e3-adb6-50675aaa6b1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:56.032042 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-87d4901c-8efb-41e3-adb6-50675aaa6b1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:56.170197 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-87d4901c-8efb-41e3-adb6-50675aaa6b1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:56.176904 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-87d4901c-8efb-41e3-adb6-50675aaa6b1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.157652 May 26 13:45:56.177482 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 102/200] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:56 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:56.626097 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-36bf82c4-ed73-42d7-8375-ddff8daac18f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:56.626695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-36bf82c4-ed73-42d7-8375-ddff8daac18f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:56.640079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36bf82c4-ed73-42d7-8375-ddff8daac18f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:56.640555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36bf82c4-ed73-42d7-8375-ddff8daac18f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:56.641619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36bf82c4-ed73-42d7-8375-ddff8daac18f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:56.642218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36bf82c4-ed73-42d7-8375-ddff8daac18f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:56.825232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-36bf82c4-ed73-42d7-8375-ddff8daac18f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:56.833794 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-36bf82c4-ed73-42d7-8375-ddff8daac18f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.220485 May 26 13:45:56.835575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 99/201] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:56 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:57.014976 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-198c2164-26c3-484a-82e0-d6058955bfac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:57.015611 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-198c2164-26c3-484a-82e0-d6058955bfac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:57.026620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-198c2164-26c3-484a-82e0-d6058955bfac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:57.026620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-198c2164-26c3-484a-82e0-d6058955bfac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:57.026620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-198c2164-26c3-484a-82e0-d6058955bfac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:57.026620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-198c2164-26c3-484a-82e0-d6058955bfac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:57.170785 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-198c2164-26c3-484a-82e0-d6058955bfac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:57.178953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-198c2164-26c3-484a-82e0-d6058955bfac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.169515 May 26 13:45:57.181610 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 103/202] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:57 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:57.194532 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8e153069-f059-4c68-bc22-e77b07c6c4e4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:57.195134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8e153069-f059-4c68-bc22-e77b07c6c4e4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:57.201813 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e153069-f059-4c68-bc22-e77b07c6c4e4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:57.202262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e153069-f059-4c68-bc22-e77b07c6c4e4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:57.203029 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e153069-f059-4c68-bc22-e77b07c6c4e4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:57.203460 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e153069-f059-4c68-bc22-e77b07c6c4e4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:57.545133 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e153069-f059-4c68-bc22-e77b07c6c4e4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:57.553490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8e153069-f059-4c68-bc22-e77b07c6c4e4 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.362110 May 26 13:45:57.554116 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 100/203] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:57 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:57.860231 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7c0b4f9c-ca35-412a-a108-8ae6250ded3e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:57.861221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7c0b4f9c-ca35-412a-a108-8ae6250ded3e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:57.870400 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7c0b4f9c-ca35-412a-a108-8ae6250ded3e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:57.870893 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7c0b4f9c-ca35-412a-a108-8ae6250ded3e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:57.872151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7c0b4f9c-ca35-412a-a108-8ae6250ded3e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:57.873106 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7c0b4f9c-ca35-412a-a108-8ae6250ded3e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:58.195490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2266098d-eb90-4b1b-b02a-6e11e2302aec tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:58.196100 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2266098d-eb90-4b1b-b02a-6e11e2302aec tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:58.205268 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2266098d-eb90-4b1b-b02a-6e11e2302aec tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:58.206110 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2266098d-eb90-4b1b-b02a-6e11e2302aec tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:58.207248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2266098d-eb90-4b1b-b02a-6e11e2302aec tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:58.207958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2266098d-eb90-4b1b-b02a-6e11e2302aec tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:58.456790 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7c0b4f9c-ca35-412a-a108-8ae6250ded3e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:58.473913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7c0b4f9c-ca35-412a-a108-8ae6250ded3e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.625677 May 26 13:45:58.476411 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 104/204] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:57 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:58.574540 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-91a42d40-ebfe-49c2-a8ea-5a1064710bb7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:58.584958 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-91a42d40-ebfe-49c2-a8ea-5a1064710bb7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:58.602916 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91a42d40-ebfe-49c2-a8ea-5a1064710bb7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:58.604732 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91a42d40-ebfe-49c2-a8ea-5a1064710bb7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:58.606795 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91a42d40-ebfe-49c2-a8ea-5a1064710bb7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:58.608665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91a42d40-ebfe-49c2-a8ea-5a1064710bb7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:58.676740 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2266098d-eb90-4b1b-b02a-6e11e2302aec tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:58.687240 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2266098d-eb90-4b1b-b02a-6e11e2302aec tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.495941 May 26 13:45:58.688205 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 101/205] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:58 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:59.392124 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-91a42d40-ebfe-49c2-a8ea-5a1064710bb7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:59.403339 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-91a42d40-ebfe-49c2-a8ea-5a1064710bb7 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.834807 May 26 13:45:59.404129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 105/206] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:58 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:59.495527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2e98596d-90f7-4928-b65d-661ff7e8dc62 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:59.496194 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2e98596d-90f7-4928-b65d-661ff7e8dc62 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:59.505298 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2e98596d-90f7-4928-b65d-661ff7e8dc62 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:59.505960 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2e98596d-90f7-4928-b65d-661ff7e8dc62 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:59.507713 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2e98596d-90f7-4928-b65d-661ff7e8dc62 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:59.508332 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2e98596d-90f7-4928-b65d-661ff7e8dc62 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:59.709428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b1d5701d-8326-4062-b632-63c9de9e8e68 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:45:59.709983 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b1d5701d-8326-4062-b632-63c9de9e8e68 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:45:59.719127 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1d5701d-8326-4062-b632-63c9de9e8e68 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:59.719822 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1d5701d-8326-4062-b632-63c9de9e8e68 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:59.721922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1d5701d-8326-4062-b632-63c9de9e8e68 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:45:59.722390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1d5701d-8326-4062-b632-63c9de9e8e68 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:45:59.751760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2e98596d-90f7-4928-b65d-661ff7e8dc62 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:59.767482 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2e98596d-90f7-4928-b65d-661ff7e8dc62 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.273842 May 26 13:45:59.778742 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 102/207] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:59 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:45:59.967801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b1d5701d-8326-4062-b632-63c9de9e8e68 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:45:59.977441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b1d5701d-8326-4062-b632-63c9de9e8e68 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.274942 May 26 13:45:59.987834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 106/208] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:45:59 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:00.423797 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fcce80c6-fae0-477b-b7ff-da768c01225e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:00.424550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fcce80c6-fae0-477b-b7ff-da768c01225e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:00.431327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcce80c6-fae0-477b-b7ff-da768c01225e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:00.431771 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcce80c6-fae0-477b-b7ff-da768c01225e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:00.432571 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcce80c6-fae0-477b-b7ff-da768c01225e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:00.432999 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcce80c6-fae0-477b-b7ff-da768c01225e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:00.580656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fcce80c6-fae0-477b-b7ff-da768c01225e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:00.585022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:00.594717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fcce80c6-fae0-477b-b7ff-da768c01225e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.174576 May 26 13:46:00.595601 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 103/209] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:00 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:00.785706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a7b9b020-6e4f-4431-aa71-7a33397e1ddb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:00.786326 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a7b9b020-6e4f-4431-aa71-7a33397e1ddb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:00.800815 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a7b9b020-6e4f-4431-aa71-7a33397e1ddb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:00.801271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a7b9b020-6e4f-4431-aa71-7a33397e1ddb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:00.802453 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a7b9b020-6e4f-4431-aa71-7a33397e1ddb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:00.803371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a7b9b020-6e4f-4431-aa71-7a33397e1ddb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:00.946988 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a7b9b020-6e4f-4431-aa71-7a33397e1ddb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:00.956562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a7b9b020-6e4f-4431-aa71-7a33397e1ddb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.174750 May 26 13:46:00.965988 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 107/210] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:00 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:00.999319 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-28855fa3-50e6-45df-868e-0010292336c9 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:00.999873 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-28855fa3-50e6-45df-868e-0010292336c9 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:01.026506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28855fa3-50e6-45df-868e-0010292336c9 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:01.026948 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28855fa3-50e6-45df-868e-0010292336c9 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:01.027749 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28855fa3-50e6-45df-868e-0010292336c9 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:01.028129 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-28855fa3-50e6-45df-868e-0010292336c9 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:01.194444 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-28855fa3-50e6-45df-868e-0010292336c9 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:01.213658 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-28855fa3-50e6-45df-868e-0010292336c9 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.222579 May 26 13:46:01.214785 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 104/211] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:00 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:01.283073 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-c63f6f8b-186c-4120-a6fd-70f008291d48 req-74dc5b7c-dc02-497d-970a-a2335f2882b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75f8bc8-637f-444e-b3f2-5f5fa9620cf9", "name": "network-vif-plugged", "status": "completed", "tag": "22ba30dc-f3ef-4d8d-aa67-0fbf99c6a3aa"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:01.295266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-c63f6f8b-186c-4120-a6fd-70f008291d48 req-74dc5b7c-dc02-497d-970a-a2335f2882b5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:01.297052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-c63f6f8b-186c-4120-a6fd-70f008291d48 req-74dc5b7c-dc02-497d-970a-a2335f2882b5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:01.328292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-c63f6f8b-186c-4120-a6fd-70f008291d48 req-74dc5b7c-dc02-497d-970a-a2335f2882b5 service nova] Creating event network-vif-plugged:22ba30dc-f3ef-4d8d-aa67-0fbf99c6a3aa for instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 on hv-cinder-81966 May 26 13:46:01.338822 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-c63f6f8b-186c-4120-a6fd-70f008291d48 req-74dc5b7c-dc02-497d-970a-a2335f2882b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071940 May 26 13:46:01.340815 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 108/212] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:01.618088 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b909a23c-e0d4-49aa-97e4-351f774cc719 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:01.619021 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b909a23c-e0d4-49aa-97e4-351f774cc719 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:01.626787 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b909a23c-e0d4-49aa-97e4-351f774cc719 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:01.628400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b909a23c-e0d4-49aa-97e4-351f774cc719 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:01.629596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b909a23c-e0d4-49aa-97e4-351f774cc719 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:01.630243 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b909a23c-e0d4-49aa-97e4-351f774cc719 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:01.946440 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b909a23c-e0d4-49aa-97e4-351f774cc719 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:01.967259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b909a23c-e0d4-49aa-97e4-351f774cc719 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.358275 May 26 13:46:01.968732 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 105/213] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:01 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:01.976107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ad77fb97-abfd-458f-839f-6b3885a766bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:01.976910 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ad77fb97-abfd-458f-839f-6b3885a766bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:01.984406 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ad77fb97-abfd-458f-839f-6b3885a766bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:01.991903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ad77fb97-abfd-458f-839f-6b3885a766bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:01.992871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ad77fb97-abfd-458f-839f-6b3885a766bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:01.994372 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ad77fb97-abfd-458f-839f-6b3885a766bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:02.213093 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ad77fb97-abfd-458f-839f-6b3885a766bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:02.216065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:02.226644 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ad77fb97-abfd-458f-839f-6b3885a766bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.256816 May 26 13:46:02.227471 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 109/214] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:01 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:02.231177 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-05cc159f-a009-41d9-a8ac-79b926ac1b6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:02.231924 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-05cc159f-a009-41d9-a8ac-79b926ac1b6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:02.239049 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05cc159f-a009-41d9-a8ac-79b926ac1b6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:02.239499 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05cc159f-a009-41d9-a8ac-79b926ac1b6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:02.241672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05cc159f-a009-41d9-a8ac-79b926ac1b6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:02.242276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-05cc159f-a009-41d9-a8ac-79b926ac1b6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:02.392423 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-05cc159f-a009-41d9-a8ac-79b926ac1b6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:02.402256 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-05cc159f-a009-41d9-a8ac-79b926ac1b6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.175167 May 26 13:46:02.403567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 106/215] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:02 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:02.986201 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ff5a120f-91be-46c8-9f3c-9838fc576e1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:02.987454 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ff5a120f-91be-46c8-9f3c-9838fc576e1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:02.997804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff5a120f-91be-46c8-9f3c-9838fc576e1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:02.998578 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff5a120f-91be-46c8-9f3c-9838fc576e1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:02.999647 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff5a120f-91be-46c8-9f3c-9838fc576e1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:03.000440 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff5a120f-91be-46c8-9f3c-9838fc576e1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:03.245191 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8502d030-da8d-4800-92e1-74dccdde7446 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:03.245825 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ff5a120f-91be-46c8-9f3c-9838fc576e1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:03.245927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8502d030-da8d-4800-92e1-74dccdde7446 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:03.253509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8502d030-da8d-4800-92e1-74dccdde7446 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:03.253971 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8502d030-da8d-4800-92e1-74dccdde7446 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:03.255873 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8502d030-da8d-4800-92e1-74dccdde7446 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:03.256242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8502d030-da8d-4800-92e1-74dccdde7446 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:03.258297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ff5a120f-91be-46c8-9f3c-9838fc576e1a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.277319 May 26 13:46:03.259213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 110/216] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:02 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:03.419813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c91b3e59-0420-4194-b903-5f58c294def1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:03.421431 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c91b3e59-0420-4194-b903-5f58c294def1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:03.429369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c91b3e59-0420-4194-b903-5f58c294def1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:03.430050 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c91b3e59-0420-4194-b903-5f58c294def1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:03.431023 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c91b3e59-0420-4194-b903-5f58c294def1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:03.431772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c91b3e59-0420-4194-b903-5f58c294def1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:03.464737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8502d030-da8d-4800-92e1-74dccdde7446 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:03.475220 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8502d030-da8d-4800-92e1-74dccdde7446 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.233440 May 26 13:46:03.476024 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 107/217] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:03 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:03.598729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c91b3e59-0420-4194-b903-5f58c294def1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:03.606468 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c91b3e59-0420-4194-b903-5f58c294def1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.191373 May 26 13:46:03.616813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 111/218] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:03 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:04.275394 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-10874220-198b-4207-a0ca-e9186b3e1cfb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:04.276010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-10874220-198b-4207-a0ca-e9186b3e1cfb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:04.287030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10874220-198b-4207-a0ca-e9186b3e1cfb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:04.287625 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10874220-198b-4207-a0ca-e9186b3e1cfb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:04.288478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10874220-198b-4207-a0ca-e9186b3e1cfb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:04.288958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-10874220-198b-4207-a0ca-e9186b3e1cfb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:04.477204 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-10874220-198b-4207-a0ca-e9186b3e1cfb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:04.488498 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-10874220-198b-4207-a0ca-e9186b3e1cfb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.216868 May 26 13:46:04.489402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 108/219] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:04 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:04.493364 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0efbd2d4-61be-4086-a83a-7e4283087b30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:04.501285 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0efbd2d4-61be-4086-a83a-7e4283087b30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:04.507285 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=96 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:04.515964 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0efbd2d4-61be-4086-a83a-7e4283087b30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:04.516504 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0efbd2d4-61be-4086-a83a-7e4283087b30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:04.517859 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0efbd2d4-61be-4086-a83a-7e4283087b30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:04.519711 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0efbd2d4-61be-4086-a83a-7e4283087b30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:04.630152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ae1dc6d4-9c92-432e-b80d-2697a3a0d8f8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:04.630712 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ae1dc6d4-9c92-432e-b80d-2697a3a0d8f8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:04.640288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae1dc6d4-9c92-432e-b80d-2697a3a0d8f8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:04.641234 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae1dc6d4-9c92-432e-b80d-2697a3a0d8f8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:04.642020 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae1dc6d4-9c92-432e-b80d-2697a3a0d8f8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:04.642454 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ae1dc6d4-9c92-432e-b80d-2697a3a0d8f8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:04.694157 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0efbd2d4-61be-4086-a83a-7e4283087b30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:04.702539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0efbd2d4-61be-4086-a83a-7e4283087b30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.213171 May 26 13:46:04.703125 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 112/220] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:04 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:04.838497 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ae1dc6d4-9c92-432e-b80d-2697a3a0d8f8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:04.847033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ae1dc6d4-9c92-432e-b80d-2697a3a0d8f8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.222764 May 26 13:46:04.847840 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 109/221] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:04 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:05.172572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-1c479708-f8cf-4767-a5a9-ed37363bce95 req-ca374f25-cda7-421d-866a-d5211bc7d86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b45620-7dd5-4bb5-9da2-e48381d78256", "name": "network-vif-plugged", "status": "completed", "tag": "fa68ed54-b95b-4bfd-afca-997df1610ee7"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:05.183450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-1c479708-f8cf-4767-a5a9-ed37363bce95 req-ca374f25-cda7-421d-866a-d5211bc7d86f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:05.183763 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-1c479708-f8cf-4767-a5a9-ed37363bce95 req-ca374f25-cda7-421d-866a-d5211bc7d86f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:05.202848 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-1c479708-f8cf-4767-a5a9-ed37363bce95 req-ca374f25-cda7-421d-866a-d5211bc7d86f service nova] Creating event network-vif-plugged:fa68ed54-b95b-4bfd-afca-997df1610ee7 for instance 84b45620-7dd5-4bb5-9da2-e48381d78256 on hv-cinder-81966 May 26 13:46:05.211237 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-1c479708-f8cf-4767-a5a9-ed37363bce95 req-ca374f25-cda7-421d-866a-d5211bc7d86f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051864 May 26 13:46:05.212074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 113/222] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:05.506506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-736ffc37-2d10-4005-bbaa-5eb69fb5e198 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:05.507120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-736ffc37-2d10-4005-bbaa-5eb69fb5e198 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:05.513223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-736ffc37-2d10-4005-bbaa-5eb69fb5e198 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:05.513924 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-736ffc37-2d10-4005-bbaa-5eb69fb5e198 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:05.514801 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-736ffc37-2d10-4005-bbaa-5eb69fb5e198 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:05.515478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-736ffc37-2d10-4005-bbaa-5eb69fb5e198 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:05.675911 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-736ffc37-2d10-4005-bbaa-5eb69fb5e198 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:05.685042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-736ffc37-2d10-4005-bbaa-5eb69fb5e198 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.182824 May 26 13:46:05.686069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 110/223] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:05 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:05.721468 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7e1878de-ebe9-4a58-8536-2bf28b06022e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:05.723082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7e1878de-ebe9-4a58-8536-2bf28b06022e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:05.730911 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e1878de-ebe9-4a58-8536-2bf28b06022e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:05.732095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e1878de-ebe9-4a58-8536-2bf28b06022e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:05.733104 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e1878de-ebe9-4a58-8536-2bf28b06022e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:05.733758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e1878de-ebe9-4a58-8536-2bf28b06022e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:05.865454 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-45a35912-17f5-4db5-958e-8ec5cc5a0456 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:05.866382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-45a35912-17f5-4db5-958e-8ec5cc5a0456 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:05.874895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45a35912-17f5-4db5-958e-8ec5cc5a0456 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:05.875588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45a35912-17f5-4db5-958e-8ec5cc5a0456 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:05.876610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45a35912-17f5-4db5-958e-8ec5cc5a0456 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:05.877199 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45a35912-17f5-4db5-958e-8ec5cc5a0456 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:05.886535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7e1878de-ebe9-4a58-8536-2bf28b06022e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:05.895125 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7e1878de-ebe9-4a58-8536-2bf28b06022e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.179017 May 26 13:46:05.905938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 114/224] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:05 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:06.071268 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-45a35912-17f5-4db5-958e-8ec5cc5a0456 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:06.085260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-45a35912-17f5-4db5-958e-8ec5cc5a0456 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1319 microversion: 2.1 time: 0.222556 May 26 13:46:06.086866 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 111/225] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:05 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:06.702971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-19c7ceed-810b-42f8-9535-7f024946b6d3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:06.703590 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-19c7ceed-810b-42f8-9535-7f024946b6d3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:06.713418 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-19c7ceed-810b-42f8-9535-7f024946b6d3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:06.713880 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-19c7ceed-810b-42f8-9535-7f024946b6d3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:06.714651 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-19c7ceed-810b-42f8-9535-7f024946b6d3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:06.715089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-19c7ceed-810b-42f8-9535-7f024946b6d3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:06.912541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ef7ad7f3-a2a6-411f-8767-37ed4c8bf3ff tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:06.913325 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ef7ad7f3-a2a6-411f-8767-37ed4c8bf3ff tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:06.922087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-19c7ceed-810b-42f8-9535-7f024946b6d3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:06.929069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef7ad7f3-a2a6-411f-8767-37ed4c8bf3ff tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:06.932963 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef7ad7f3-a2a6-411f-8767-37ed4c8bf3ff tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:06.934508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-19c7ceed-810b-42f8-9535-7f024946b6d3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.235406 May 26 13:46:06.935392 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 115/226] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:06 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:06.945010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef7ad7f3-a2a6-411f-8767-37ed4c8bf3ff tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:06.946598 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef7ad7f3-a2a6-411f-8767-37ed4c8bf3ff tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:07.105814 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-550a830c-337f-4f76-8021-67ace4af0868 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:07.106493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-550a830c-337f-4f76-8021-67ace4af0868 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:07.120077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-550a830c-337f-4f76-8021-67ace4af0868 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:07.120592 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-550a830c-337f-4f76-8021-67ace4af0868 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:07.121395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-550a830c-337f-4f76-8021-67ace4af0868 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:07.121839 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-550a830c-337f-4f76-8021-67ace4af0868 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:07.265057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ef7ad7f3-a2a6-411f-8767-37ed4c8bf3ff tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:07.279480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ef7ad7f3-a2a6-411f-8767-37ed4c8bf3ff tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.370332 May 26 13:46:07.289317 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 112/227] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:06 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:07.354308 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-550a830c-337f-4f76-8021-67ace4af0868 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:07.362557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-550a830c-337f-4f76-8021-67ace4af0868 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1513 microversion: 2.1 time: 0.263289 May 26 13:46:07.375535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 116/228] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:07 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:07.381662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3c8f11b6-ee0b-4bcb-a0a1-a017d9f9a2c8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:07.382761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3c8f11b6-ee0b-4bcb-a0a1-a017d9f9a2c8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:07.392434 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c8f11b6-ee0b-4bcb-a0a1-a017d9f9a2c8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:07.395655 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c8f11b6-ee0b-4bcb-a0a1-a017d9f9a2c8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:07.400624 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c8f11b6-ee0b-4bcb-a0a1-a017d9f9a2c8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:07.401747 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c8f11b6-ee0b-4bcb-a0a1-a017d9f9a2c8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:07.439596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-3c8f11b6-ee0b-4bcb-a0a1-a017d9f9a2c8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lazy-loading 'flavor' on Instance uuid b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:46:07.653048 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3c8f11b6-ee0b-4bcb-a0a1-a017d9f9a2c8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9/action" status: 200 len: 32 microversion: 2.1 time: 0.275782 May 26 13:46:07.654448 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 113/229] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:46:07 2022] POST /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9/action => generated 32 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:46:07.664211 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-531880df-4024-4a84-a5cc-cd16a6bd8c1c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:07.664853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-531880df-4024-4a84-a5cc-cd16a6bd8c1c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:07.671358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-531880df-4024-4a84-a5cc-cd16a6bd8c1c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:07.671884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-531880df-4024-4a84-a5cc-cd16a6bd8c1c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:07.672685 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-531880df-4024-4a84-a5cc-cd16a6bd8c1c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:07.673161 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-531880df-4024-4a84-a5cc-cd16a6bd8c1c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:07.853929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-531880df-4024-4a84-a5cc-cd16a6bd8c1c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:07.863223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-531880df-4024-4a84-a5cc-cd16a6bd8c1c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.203761 May 26 13:46:07.863908 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 117/230] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:07 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:07.952016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fd1e9590-cf96-4527-92a9-9922366852eb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:07.953282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fd1e9590-cf96-4527-92a9-9922366852eb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:07.961095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd1e9590-cf96-4527-92a9-9922366852eb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:07.961813 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd1e9590-cf96-4527-92a9-9922366852eb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:07.962623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd1e9590-cf96-4527-92a9-9922366852eb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:07.963245 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd1e9590-cf96-4527-92a9-9922366852eb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:08.126257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fd1e9590-cf96-4527-92a9-9922366852eb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:08.135770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fd1e9590-cf96-4527-92a9-9922366852eb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.188148 May 26 13:46:08.145474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 114/231] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:07 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:08.297253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8b357204-b7ed-4493-9d86-8e68b86dff22 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:08.298632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8b357204-b7ed-4493-9d86-8e68b86dff22 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:08.308791 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8b357204-b7ed-4493-9d86-8e68b86dff22 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:08.309276 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8b357204-b7ed-4493-9d86-8e68b86dff22 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:08.310069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8b357204-b7ed-4493-9d86-8e68b86dff22 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:08.310514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8b357204-b7ed-4493-9d86-8e68b86dff22 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:08.456626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8b357204-b7ed-4493-9d86-8e68b86dff22 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:08.467389 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8b357204-b7ed-4493-9d86-8e68b86dff22 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.174773 May 26 13:46:08.468941 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 118/232] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:08 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:08.882352 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ffba4952-dee2-4242-8c28-f9cde48f016c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:08.883101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ffba4952-dee2-4242-8c28-f9cde48f016c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:08.905790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffba4952-dee2-4242-8c28-f9cde48f016c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:08.906276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffba4952-dee2-4242-8c28-f9cde48f016c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:08.907091 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffba4952-dee2-4242-8c28-f9cde48f016c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:08.907659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ffba4952-dee2-4242-8c28-f9cde48f016c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.029128 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c28e423a-1310-4a1d-9b30-7367732c76b2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:09.030095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c28e423a-1310-4a1d-9b30-7367732c76b2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:09.040507 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c28e423a-1310-4a1d-9b30-7367732c76b2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.041184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c28e423a-1310-4a1d-9b30-7367732c76b2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.043832 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c28e423a-1310-4a1d-9b30-7367732c76b2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.044523 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c28e423a-1310-4a1d-9b30-7367732c76b2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.089616 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c28e423a-1310-4a1d-9b30-7367732c76b2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:46:09.123362 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ffba4952-dee2-4242-8c28-f9cde48f016c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:09.133186 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ffba4952-dee2-4242-8c28-f9cde48f016c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.256460 May 26 13:46:09.134263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 115/233] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:08 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:09.154691 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a470545b-1bc4-4b6d-8843-57eb741795fe tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:09.155941 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a470545b-1bc4-4b6d-8843-57eb741795fe tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:09.163815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a470545b-1bc4-4b6d-8843-57eb741795fe tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.164877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a470545b-1bc4-4b6d-8843-57eb741795fe tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.165860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a470545b-1bc4-4b6d-8843-57eb741795fe tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.166657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a470545b-1bc4-4b6d-8843-57eb741795fe tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.216241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c28e423a-1310-4a1d-9b30-7367732c76b2 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 204 len: 0 microversion: 2.1 time: 0.192932 May 26 13:46:09.218061 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:46:09 2022] DELETE /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:46:09.235959 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-916b7e21-7d51-4cd9-8543-c16f8eb3ff16 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:09.237002 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-916b7e21-7d51-4cd9-8543-c16f8eb3ff16 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:09.249928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-916b7e21-7d51-4cd9-8543-c16f8eb3ff16 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.251283 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-916b7e21-7d51-4cd9-8543-c16f8eb3ff16 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.252085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-916b7e21-7d51-4cd9-8543-c16f8eb3ff16 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.254323 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-916b7e21-7d51-4cd9-8543-c16f8eb3ff16 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.360512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a470545b-1bc4-4b6d-8843-57eb741795fe tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:09.373501 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a470545b-1bc4-4b6d-8843-57eb741795fe tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.223899 May 26 13:46:09.374286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 116/235] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:09 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:09.410120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-94a392d4-e3a8-487c-87bf-c46c93b01529 req-2797d705-f174-40ad-8dc3-6b32938fd5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1", "name": "network-vif-plugged", "status": "completed", "tag": "16b9a0f5-441f-49b0-90d7-fb4d546e3615"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:09.422635 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-94a392d4-e3a8-487c-87bf-c46c93b01529 req-2797d705-f174-40ad-8dc3-6b32938fd5a5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.423103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-94a392d4-e3a8-487c-87bf-c46c93b01529 req-2797d705-f174-40ad-8dc3-6b32938fd5a5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.439277 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-94a392d4-e3a8-487c-87bf-c46c93b01529 req-2797d705-f174-40ad-8dc3-6b32938fd5a5 service nova] Creating event network-vif-plugged:16b9a0f5-441f-49b0-90d7-fb4d546e3615 for instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 on hv-cinder-81966 May 26 13:46:09.446922 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-94a392d4-e3a8-487c-87bf-c46c93b01529 req-2797d705-f174-40ad-8dc3-6b32938fd5a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041957 May 26 13:46:09.448602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 117/236] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:09.453459 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-916b7e21-7d51-4cd9-8543-c16f8eb3ff16 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:09.462858 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-916b7e21-7d51-4cd9-8543-c16f8eb3ff16 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1553 microversion: 2.1 time: 0.239707 May 26 13:46:09.463447 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 120/237] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:09 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1553 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:09.487891 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-26e6af8b-c154-4d7c-8ce3-02ed6044435b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:09.488632 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-26e6af8b-c154-4d7c-8ce3-02ed6044435b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:09.496721 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26e6af8b-c154-4d7c-8ce3-02ed6044435b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.497186 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26e6af8b-c154-4d7c-8ce3-02ed6044435b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.497990 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26e6af8b-c154-4d7c-8ce3-02ed6044435b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:09.498426 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26e6af8b-c154-4d7c-8ce3-02ed6044435b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:09.655606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-26e6af8b-c154-4d7c-8ce3-02ed6044435b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:09.668097 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-26e6af8b-c154-4d7c-8ce3-02ed6044435b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.186550 May 26 13:46:09.679990 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 118/238] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:09 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:10.150340 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-36bdd90f-49f4-40d4-9538-a9e9cc93de69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:10.151187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-36bdd90f-49f4-40d4-9538-a9e9cc93de69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:10.163880 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-36bdd90f-49f4-40d4-9538-a9e9cc93de69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:10.164487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-36bdd90f-49f4-40d4-9538-a9e9cc93de69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:10.165304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-36bdd90f-49f4-40d4-9538-a9e9cc93de69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:10.165746 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-36bdd90f-49f4-40d4-9538-a9e9cc93de69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:10.323033 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-36bdd90f-49f4-40d4-9538-a9e9cc93de69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:10.332506 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-36bdd90f-49f4-40d4-9538-a9e9cc93de69 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.185835 May 26 13:46:10.333951 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 121/239] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:10 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:10.391130 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c8a78c00-ca75-404a-80c9-31f312ae255e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:10.392485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c8a78c00-ca75-404a-80c9-31f312ae255e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:10.399957 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8a78c00-ca75-404a-80c9-31f312ae255e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:10.400911 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8a78c00-ca75-404a-80c9-31f312ae255e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:10.403193 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8a78c00-ca75-404a-80c9-31f312ae255e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:10.403988 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8a78c00-ca75-404a-80c9-31f312ae255e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:10.408877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:10.483239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2484950b-b043-4a62-87ff-8cb3b13b7a6c tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:10.483974 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2484950b-b043-4a62-87ff-8cb3b13b7a6c tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:10.494665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2484950b-b043-4a62-87ff-8cb3b13b7a6c tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:10.495116 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2484950b-b043-4a62-87ff-8cb3b13b7a6c tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:10.497422 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2484950b-b043-4a62-87ff-8cb3b13b7a6c tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:10.497903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2484950b-b043-4a62-87ff-8cb3b13b7a6c tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:10.764650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2484950b-b043-4a62-87ff-8cb3b13b7a6c tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:10.777086 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2484950b-b043-4a62-87ff-8cb3b13b7a6c tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1553 microversion: 2.1 time: 0.300620 May 26 13:46:10.778302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 122/240] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:10 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1553 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:10.785360 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ca347756-01e6-4c08-8855-e3b663dfd0f9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:10.788608 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ca347756-01e6-4c08-8855-e3b663dfd0f9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:10.800542 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ca347756-01e6-4c08-8855-e3b663dfd0f9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:10.801007 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ca347756-01e6-4c08-8855-e3b663dfd0f9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:10.802014 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ca347756-01e6-4c08-8855-e3b663dfd0f9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:10.803077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ca347756-01e6-4c08-8855-e3b663dfd0f9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:10.821054 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c8a78c00-ca75-404a-80c9-31f312ae255e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:10.842926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c8a78c00-ca75-404a-80c9-31f312ae255e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.453733 May 26 13:46:10.856200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 119/241] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:10 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:10.990692 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ca347756-01e6-4c08-8855-e3b663dfd0f9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:11.000316 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ca347756-01e6-4c08-8855-e3b663dfd0f9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1362 microversion: 2.1 time: 0.220133 May 26 13:46:11.010925 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 123/242] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:10 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:11.351898 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-74311416-2496-4ee0-a7fd-fa7d434beac1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:11.352331 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-74311416-2496-4ee0-a7fd-fa7d434beac1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:11.358814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74311416-2496-4ee0-a7fd-fa7d434beac1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:11.359258 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74311416-2496-4ee0-a7fd-fa7d434beac1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:11.360024 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74311416-2496-4ee0-a7fd-fa7d434beac1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:11.360701 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74311416-2496-4ee0-a7fd-fa7d434beac1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:11.612150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74311416-2496-4ee0-a7fd-fa7d434beac1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:11.623480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-74311416-2496-4ee0-a7fd-fa7d434beac1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.275286 May 26 13:46:11.626043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 120/243] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:11 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:11.795419 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3ad2a200-f291-4553-88b6-ec82fb301952 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:11.796921 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3ad2a200-f291-4553-88b6-ec82fb301952 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:11.804100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3ad2a200-f291-4553-88b6-ec82fb301952 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:11.804970 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3ad2a200-f291-4553-88b6-ec82fb301952 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:11.805908 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3ad2a200-f291-4553-88b6-ec82fb301952 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:11.806353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3ad2a200-f291-4553-88b6-ec82fb301952 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:11.864476 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cb6e878d-3d9a-4cde-bdd3-2dd57ef7a608 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:11.869047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cb6e878d-3d9a-4cde-bdd3-2dd57ef7a608 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:11.886076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb6e878d-3d9a-4cde-bdd3-2dd57ef7a608 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:11.888807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb6e878d-3d9a-4cde-bdd3-2dd57ef7a608 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:11.890274 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb6e878d-3d9a-4cde-bdd3-2dd57ef7a608 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:11.893026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cb6e878d-3d9a-4cde-bdd3-2dd57ef7a608 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:11.988501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3ad2a200-f291-4553-88b6-ec82fb301952 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:11.997569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3ad2a200-f291-4553-88b6-ec82fb301952 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1553 microversion: 2.1 time: 0.206440 May 26 13:46:11.998239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 124/244] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:11 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1553 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:12.022643 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7f0990f1-2d56-4961-956b-53382a34b520 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:12.023266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7f0990f1-2d56-4961-956b-53382a34b520 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:12.033890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f0990f1-2d56-4961-956b-53382a34b520 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:12.035005 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f0990f1-2d56-4961-956b-53382a34b520 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:12.036023 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f0990f1-2d56-4961-956b-53382a34b520 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:12.036555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f0990f1-2d56-4961-956b-53382a34b520 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:12.054852 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:12.100006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cb6e878d-3d9a-4cde-bdd3-2dd57ef7a608 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:12.108791 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cb6e878d-3d9a-4cde-bdd3-2dd57ef7a608 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.251827 May 26 13:46:12.109469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 121/245] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:11 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:12.221730 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7f0990f1-2d56-4961-956b-53382a34b520 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:12.231715 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7f0990f1-2d56-4961-956b-53382a34b520 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1549 microversion: 2.1 time: 0.213851 May 26 13:46:12.232944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 125/246] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:12 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1549 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:12.249912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ef5db7be-72fb-4c7c-9050-f53a0e5823c8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:12.250424 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ef5db7be-72fb-4c7c-9050-f53a0e5823c8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:12.257758 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef5db7be-72fb-4c7c-9050-f53a0e5823c8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:12.258175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef5db7be-72fb-4c7c-9050-f53a0e5823c8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:12.258944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef5db7be-72fb-4c7c-9050-f53a0e5823c8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:12.259379 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ef5db7be-72fb-4c7c-9050-f53a0e5823c8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:12.344421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ef5db7be-72fb-4c7c-9050-f53a0e5823c8 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098187 May 26 13:46:12.345252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 122/247] 10.222.0.16 () {58 vars in 1274 bytes} [Thu May 26 13:46:12 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:12.647798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c1c2ec8f-f647-488a-b711-50f3d820c00c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:12.648549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c1c2ec8f-f647-488a-b711-50f3d820c00c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:12.662082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec8f-f647-488a-b711-50f3d820c00c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:12.662750 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec8f-f647-488a-b711-50f3d820c00c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:12.664071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec8f-f647-488a-b711-50f3d820c00c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:12.666686 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c1c2ec8f-f647-488a-b711-50f3d820c00c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:13.017038 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-17e2732a-f422-49f8-98ae-434764149502 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:13.018311 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-17e2732a-f422-49f8-98ae-434764149502 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:13.038549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17e2732a-f422-49f8-98ae-434764149502 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:13.045119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17e2732a-f422-49f8-98ae-434764149502 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:13.048369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17e2732a-f422-49f8-98ae-434764149502 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:13.051777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17e2732a-f422-49f8-98ae-434764149502 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:13.092953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c1c2ec8f-f647-488a-b711-50f3d820c00c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:13.109120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c1c2ec8f-f647-488a-b711-50f3d820c00c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.470203 May 26 13:46:13.118673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 126/248] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:12 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:13.127772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8bde1c95-80af-43bf-a23a-dd2f47633275 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:13.128443 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8bde1c95-80af-43bf-a23a-dd2f47633275 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:13.137293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8bde1c95-80af-43bf-a23a-dd2f47633275 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:13.138008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8bde1c95-80af-43bf-a23a-dd2f47633275 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:13.139027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8bde1c95-80af-43bf-a23a-dd2f47633275 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:13.139587 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8bde1c95-80af-43bf-a23a-dd2f47633275 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:13.396805 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-17e2732a-f422-49f8-98ae-434764149502 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:13.405370 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-17e2732a-f422-49f8-98ae-434764149502 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1553 microversion: 2.1 time: 0.393939 May 26 13:46:13.406206 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 123/249] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:13 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1553 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:13.468837 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-211b0e93-afe7-4864-99e4-80acef5b3f9c req-ebfb9fe0-e355-499e-bcbb-2952aede6330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aac6ee1-e33c-4957-bb97-39e23139ba63", "name": "network-vif-deleted", "tag": "1b5743b4-b6c9-449d-9b8a-dd2f82596278"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:13.479985 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-211b0e93-afe7-4864-99e4-80acef5b3f9c req-ebfb9fe0-e355-499e-bcbb-2952aede6330 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:13.480903 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-211b0e93-afe7-4864-99e4-80acef5b3f9c req-ebfb9fe0-e355-499e-bcbb-2952aede6330 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:13.495012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-211b0e93-afe7-4864-99e4-80acef5b3f9c req-ebfb9fe0-e355-499e-bcbb-2952aede6330 service nova] Creating event network-vif-deleted:1b5743b4-b6c9-449d-9b8a-dd2f82596278 for instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 on hv-cinder-81966 May 26 13:46:13.501970 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-211b0e93-afe7-4864-99e4-80acef5b3f9c req-ebfb9fe0-e355-499e-bcbb-2952aede6330 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036937 May 26 13:46:13.502751 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 124/250] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:46:13.798491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8bde1c95-80af-43bf-a23a-dd2f47633275 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:13.807952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8bde1c95-80af-43bf-a23a-dd2f47633275 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.685233 May 26 13:46:13.808585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 127/251] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:13 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:14.128659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-27beac66-a62b-4656-b3be-20253a916ad0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:14.131575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-27beac66-a62b-4656-b3be-20253a916ad0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:14.140855 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27beac66-a62b-4656-b3be-20253a916ad0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:14.142282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27beac66-a62b-4656-b3be-20253a916ad0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:14.143235 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27beac66-a62b-4656-b3be-20253a916ad0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:14.144411 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27beac66-a62b-4656-b3be-20253a916ad0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:14.424215 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:14.424911 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:14.438563 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:14.439884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:14.443052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:14.450076 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:14.484645 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-27beac66-a62b-4656-b3be-20253a916ad0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:14.499603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-27beac66-a62b-4656-b3be-20253a916ad0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.374353 May 26 13:46:14.501618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 125/252] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:14 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:14.542550 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:14.543341 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:14.544167 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lazy-loading 'fault' on Instance uuid 4aac6ee1-e33c-4957-bb97-39e23139ba63 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:46:14.664618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43bfa3b0a2a4fa28ef2e80295fed484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a22ae4c671d4c828ea95651dd7ec9cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:14.675306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-7da90fd2-7e28-4bf5-b845-c3ed59528dee req-57e10d01-c81d-4b94-8cc6-2d01d12b14dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84b45620-7dd5-4bb5-9da2-e48381d78256", "tag": "fa68ed54-b95b-4bfd-afca-997df1610ee7"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:14.706555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0ce13b1d-9f83-4d04-af7c-6314670a04bb tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 200 len: 1350 microversion: 2.1 time: 0.286576 May 26 13:46:14.707104 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 128/253] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:14 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 1350 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:14.716567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-7da90fd2-7e28-4bf5-b845-c3ed59528dee req-57e10d01-c81d-4b94-8cc6-2d01d12b14dd service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:14.716567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-7da90fd2-7e28-4bf5-b845-c3ed59528dee req-57e10d01-c81d-4b94-8cc6-2d01d12b14dd service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:14.724464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-7da90fd2-7e28-4bf5-b845-c3ed59528dee req-57e10d01-c81d-4b94-8cc6-2d01d12b14dd service nova] Creating event network-changed:fa68ed54-b95b-4bfd-afca-997df1610ee7 for instance 84b45620-7dd5-4bb5-9da2-e48381d78256 on hv-cinder-81966 May 26 13:46:14.730737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-7da90fd2-7e28-4bf5-b845-c3ed59528dee req-57e10d01-c81d-4b94-8cc6-2d01d12b14dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059788 May 26 13:46:14.731421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 126/254] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:46:14.831035 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e8ebedcc-2c55-4025-b41d-b13912f6e74e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:14.831762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e8ebedcc-2c55-4025-b41d-b13912f6e74e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:14.841804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e8ebedcc-2c55-4025-b41d-b13912f6e74e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:14.842803 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e8ebedcc-2c55-4025-b41d-b13912f6e74e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:14.844168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e8ebedcc-2c55-4025-b41d-b13912f6e74e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:14.846241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e8ebedcc-2c55-4025-b41d-b13912f6e74e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:15.040001 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e8ebedcc-2c55-4025-b41d-b13912f6e74e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:15.050584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e8ebedcc-2c55-4025-b41d-b13912f6e74e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1314 microversion: 2.1 time: 0.227012 May 26 13:46:15.051242 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 129/255] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:14 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:15.522360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-58205522-856f-4ae4-b8e4-114f2bd2f58a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:15.524783 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-58205522-856f-4ae4-b8e4-114f2bd2f58a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:15.552668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58205522-856f-4ae4-b8e4-114f2bd2f58a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:15.554199 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58205522-856f-4ae4-b8e4-114f2bd2f58a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:15.554199 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58205522-856f-4ae4-b8e4-114f2bd2f58a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:15.554387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58205522-856f-4ae4-b8e4-114f2bd2f58a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:15.727003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:15.727817 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:15.735399 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:15.736268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:15.737184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:15.737733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:15.766990 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] HTTP exception thrown: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Request method failure captured: May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 HTTP/1.1 May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RIxSdGyDMmogXPqXmH7eZgVEExYs1NvzF0jBtaT_HyxSJMUYdVaixy4uWJnxONJ1STmBGy2lLzEC3TRBMZzTWGeW7VWuoLNSNjDNUs_4ErU32gRUYh2IpTU041ndhGhyzrVAeyhgEPiTPSzY5-poSbr22WfkLWEhyHO19ZsNKpd1A May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 7a22ae4c671d4c828ea95651dd7ec9cd May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:46:15.775100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a22ae4c671d4c828ea95651dd7ec9cd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 7a22ae4c671d4c828ea95651dd7ec9cd May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-DeleteServersTestJSON-2062572267-project May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: f43bfa3b0a2a4fa28ef2e80295fed484 May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-DeleteServersTestJSON-2062572267-project May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:15.776753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '4aac6ee1-e33c-4957-bb97-39e23139ba63'} May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:46:15.777603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:15.779883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:15.781946 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Returning 404 to user: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:46:15.781946 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c77d7e69-58f8-4008-8d5f-35af6626c353 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 404 len: 111 microversion: 2.1 time: 0.054276 May 26 13:46:15.783673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 130/256] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:15 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:46:15.979163 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:15.980845 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:15.994925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58205522-856f-4ae4-b8e4-114f2bd2f58a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:15.996967 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:15.998310 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:16.000818 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:16.003553 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:16.003686 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-58205522-856f-4ae4-b8e4-114f2bd2f58a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.488258 May 26 13:46:16.007549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 127/257] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:15 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:16.037844 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] HTTP exception thrown: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Request method failure captured: May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63/os-volume_attachments HTTP/1.1 May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RIxSdGyDMmogXPqXmH7eZgVEExYs1NvzF0jBtaT_HyxSJMUYdVaixy4uWJnxONJ1STmBGy2lLzEC3TRBMZzTWGeW7VWuoLNSNjDNUs_4ErU32gRUYh2IpTU041ndhGhyzrVAeyhgEPiTPSzY5-poSbr22WfkLWEhyHO19ZsNKpd1A May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 7a22ae4c671d4c828ea95651dd7ec9cd May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:46:16.052054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a22ae4c671d4c828ea95651dd7ec9cd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 7a22ae4c671d4c828ea95651dd7ec9cd May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-DeleteServersTestJSON-2062572267-project May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: f43bfa3b0a2a4fa28ef2e80295fed484 May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-DeleteServersTestJSON-2062572267-project May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:16.053293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'server_id': '4aac6ee1-e33c-4957-bb97-39e23139ba63'} May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:46:16.053931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:16.054982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:46:16.059600 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Returning 404 to user: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:46:16.062797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f34e586a-6f0d-43dc-8ea7-4108c4da8d45 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.089885 May 26 13:46:16.065379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 131/258] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:46:15 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:46:16.071423 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8a7829ce-44b8-42e5-a21e-8fbde3891f7a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:16.073488 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8a7829ce-44b8-42e5-a21e-8fbde3891f7a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:16.090642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a7829ce-44b8-42e5-a21e-8fbde3891f7a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:16.091126 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a7829ce-44b8-42e5-a21e-8fbde3891f7a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:16.091924 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a7829ce-44b8-42e5-a21e-8fbde3891f7a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:16.092387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8a7829ce-44b8-42e5-a21e-8fbde3891f7a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:16.418478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8a7829ce-44b8-42e5-a21e-8fbde3891f7a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:16.428136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8a7829ce-44b8-42e5-a21e-8fbde3891f7a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1497 microversion: 2.1 time: 0.364745 May 26 13:46:16.440857 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 128/259] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:16 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1497 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:17.027893 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-95821435-6c59-439f-b988-83f424752df4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:17.028550 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-95821435-6c59-439f-b988-83f424752df4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:17.037978 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-95821435-6c59-439f-b988-83f424752df4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.038526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-95821435-6c59-439f-b988-83f424752df4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.039566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-95821435-6c59-439f-b988-83f424752df4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.040159 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-95821435-6c59-439f-b988-83f424752df4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.164251 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7a3e3cb9-0e7c-4e2c-9e0f-2557b4d52c84 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:17.165559 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7a3e3cb9-0e7c-4e2c-9e0f-2557b4d52c84 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:17.173113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a3e3cb9-0e7c-4e2c-9e0f-2557b4d52c84 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.174035 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a3e3cb9-0e7c-4e2c-9e0f-2557b4d52c84 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.175008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a3e3cb9-0e7c-4e2c-9e0f-2557b4d52c84 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.175809 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a3e3cb9-0e7c-4e2c-9e0f-2557b4d52c84 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.215369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7a3e3cb9-0e7c-4e2c-9e0f-2557b4d52c84 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:46:17.302705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-95821435-6c59-439f-b988-83f424752df4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:17.311978 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-95821435-6c59-439f-b988-83f424752df4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.292077 May 26 13:46:17.312887 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 132/260] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:17 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:17.378976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7a3e3cb9-0e7c-4e2c-9e0f-2557b4d52c84 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 204 len: 0 microversion: 2.1 time: 0.219514 May 26 13:46:17.390931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-14af4690-0f24-44db-ae89-825f9ccda496 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:17.391822 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-14af4690-0f24-44db-ae89-825f9ccda496 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:17.397043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 129/261] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:46:17 2022] DELETE /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:46:17.402577 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14af4690-0f24-44db-ae89-825f9ccda496 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.403194 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14af4690-0f24-44db-ae89-825f9ccda496 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.404154 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14af4690-0f24-44db-ae89-825f9ccda496 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.404945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14af4690-0f24-44db-ae89-825f9ccda496 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.419820 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:17.420436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:17.430853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.431300 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.432080 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.432553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.474680 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] HTTP exception thrown: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Request method failure captured: May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 HTTP/1.1 May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RIxSdGyDMmogXPqXmH7eZgVEExYs1NvzF0jBtaT_HyxSJMUYdVaixy4uWJnxONJ1STmBGy2lLzEC3TRBMZzTWGeW7VWuoLNSNjDNUs_4ErU32gRUYh2IpTU041ndhGhyzrVAeyhgEPiTPSzY5-poSbr22WfkLWEhyHO19ZsNKpd1A May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 7a22ae4c671d4c828ea95651dd7ec9cd May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:46:17.485242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a22ae4c671d4c828ea95651dd7ec9cd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 7a22ae4c671d4c828ea95651dd7ec9cd May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-DeleteServersTestJSON-2062572267-project May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: f43bfa3b0a2a4fa28ef2e80295fed484 May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-DeleteServersTestJSON-2062572267-project May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.486790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '4aac6ee1-e33c-4957-bb97-39e23139ba63'} May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:46:17.487562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.488621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.489770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Returning 404 to user: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:46:17.489770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-35fe3953-c020-4c9e-a90f-daf62bd9a35e tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 404 len: 111 microversion: 2.1 time: 0.073347 May 26 13:46:17.490945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 130/262] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:46:17 2022] DELETE /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:46:17.495833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:17.496607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] [instance: 4aac6ee1-e33c-4957-bb97-39e23139ba63] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:17.503490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.503935 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.505255 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:17.505729 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:17.525365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] HTTP exception thrown: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Request method failure captured: May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 HTTP/1.1 May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RIxSdGyDMmogXPqXmH7eZgVEExYs1NvzF0jBtaT_HyxSJMUYdVaixy4uWJnxONJ1STmBGy2lLzEC3TRBMZzTWGeW7VWuoLNSNjDNUs_4ErU32gRUYh2IpTU041ndhGhyzrVAeyhgEPiTPSzY5-poSbr22WfkLWEhyHO19ZsNKpd1A May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 7a22ae4c671d4c828ea95651dd7ec9cd May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:46:17.526938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a22ae4c671d4c828ea95651dd7ec9cd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a22ae4c671d4c828ea95651dd7ec9cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 7a22ae4c671d4c828ea95651dd7ec9cd May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-DeleteServersTestJSON-2062572267 May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-DeleteServersTestJSON-2062572267-project May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: f43bfa3b0a2a4fa28ef2e80295fed484 May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-DeleteServersTestJSON-2062572267-project May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.528096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '4aac6ee1-e33c-4957-bb97-39e23139ba63'} May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:46:17.528804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. May 26 13:46:17.530410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:17.531347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] Returning 404 to user: Instance 4aac6ee1-e33c-4957-bb97-39e23139ba63 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:46:17.531347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6c800cb9-218e-4386-a230-1335674e1397 tempest-DeleteServersTestJSON-2062572267 tempest-DeleteServersTestJSON-2062572267-project] 10.222.0.16 "GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63" status: 404 len: 111 microversion: 2.1 time: 0.036455 May 26 13:46:17.532882 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 131/263] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:17 2022] GET /compute/v2.1/servers/4aac6ee1-e33c-4957-bb97-39e23139ba63 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:46:17.737448 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-14af4690-0f24-44db-ae89-825f9ccda496 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:17.746080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-14af4690-0f24-44db-ae89-825f9ccda496 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1503 microversion: 2.1 time: 0.360458 May 26 13:46:17.746753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 133/264] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:17 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1503 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:18.330664 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7df89d61-3ea1-4059-b78c-bc52cebc3d16 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:18.331488 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7df89d61-3ea1-4059-b78c-bc52cebc3d16 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:18.339745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7df89d61-3ea1-4059-b78c-bc52cebc3d16 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:18.340424 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7df89d61-3ea1-4059-b78c-bc52cebc3d16 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:18.351942 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7df89d61-3ea1-4059-b78c-bc52cebc3d16 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:18.352834 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7df89d61-3ea1-4059-b78c-bc52cebc3d16 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:18.569201 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7df89d61-3ea1-4059-b78c-bc52cebc3d16 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:18.589490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7df89d61-3ea1-4059-b78c-bc52cebc3d16 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.263582 May 26 13:46:18.590361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 132/265] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:18 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:18.764105 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-edc50850-40d9-439e-a38b-16be8f526d1e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:18.765104 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-edc50850-40d9-439e-a38b-16be8f526d1e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:18.772942 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-edc50850-40d9-439e-a38b-16be8f526d1e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:18.773535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-edc50850-40d9-439e-a38b-16be8f526d1e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:18.774427 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-edc50850-40d9-439e-a38b-16be8f526d1e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:18.775260 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-edc50850-40d9-439e-a38b-16be8f526d1e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:19.091170 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-edc50850-40d9-439e-a38b-16be8f526d1e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:19.110190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-edc50850-40d9-439e-a38b-16be8f526d1e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1503 microversion: 2.1 time: 0.343599 May 26 13:46:19.127056 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 134/266] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:18 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:19.608068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-efc51689-da2c-4f1a-bd22-bb359cfad2d3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:19.609524 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-efc51689-da2c-4f1a-bd22-bb359cfad2d3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:19.619045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efc51689-da2c-4f1a-bd22-bb359cfad2d3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:19.623517 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efc51689-da2c-4f1a-bd22-bb359cfad2d3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:19.625601 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efc51689-da2c-4f1a-bd22-bb359cfad2d3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:19.627746 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efc51689-da2c-4f1a-bd22-bb359cfad2d3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:20.128734 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d8daa9f6-3d0b-454c-909e-9b82e4833675 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:20.129373 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d8daa9f6-3d0b-454c-909e-9b82e4833675 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:20.144931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d8daa9f6-3d0b-454c-909e-9b82e4833675 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:20.146253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d8daa9f6-3d0b-454c-909e-9b82e4833675 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:20.148975 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d8daa9f6-3d0b-454c-909e-9b82e4833675 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:20.149922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d8daa9f6-3d0b-454c-909e-9b82e4833675 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:20.218807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-efc51689-da2c-4f1a-bd22-bb359cfad2d3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:20.258295 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-efc51689-da2c-4f1a-bd22-bb359cfad2d3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.653064 May 26 13:46:20.260532 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 133/267] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:19 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:20.415636 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d8daa9f6-3d0b-454c-909e-9b82e4833675 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:20.421142 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d8daa9f6-3d0b-454c-909e-9b82e4833675 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1503 microversion: 2.1 time: 0.295946 May 26 13:46:20.434526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 135/268] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:20 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:20.802121 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-72901bc4-4897-459a-8b49-76301e9992bd tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Action: 'create', calling method: .version_select at 0x7f07e0f38550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-364625476", "metadata": {"Type": "work"}}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:21.277884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9bb34ff5-b06a-458b-a4ff-864a1376698f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:21.279185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9bb34ff5-b06a-458b-a4ff-864a1376698f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:21.316866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9bb34ff5-b06a-458b-a4ff-864a1376698f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:21.318671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9bb34ff5-b06a-458b-a4ff-864a1376698f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:21.320779 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9bb34ff5-b06a-458b-a4ff-864a1376698f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:21.326217 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9bb34ff5-b06a-458b-a4ff-864a1376698f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:21.416544 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-72901bc4-4897-459a-8b49-76301e9992bd tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.809352 May 26 13:46:21.417236 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 134/269] 10.222.0.16 () {60 vars in 1155 bytes} [Thu May 26 13:46:20 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 811 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 26 13:46:21.429275 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-698bd41e-ea60-4f11-be07-7f726a8060c5 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0e834c0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:21.531553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-698bd41e-ea60-4f11-be07-7f726a8060c5 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 352 microversion: 2.1 time: 0.106933 May 26 13:46:21.532906 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 135/270] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:21 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:21.538426 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cde68258-3a31-4421-9369-2d84f4157093 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:21.539200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cde68258-3a31-4421-9369-2d84f4157093 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:21.553304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cde68258-3a31-4421-9369-2d84f4157093 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:21.553759 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cde68258-3a31-4421-9369-2d84f4157093 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:21.554619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cde68258-3a31-4421-9369-2d84f4157093 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:21.555288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cde68258-3a31-4421-9369-2d84f4157093 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:21.745276 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9bb34ff5-b06a-458b-a4ff-864a1376698f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:21.758388 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9bb34ff5-b06a-458b-a4ff-864a1376698f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.486139 May 26 13:46:21.760110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 136/271] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:21 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:21.918691 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cde68258-3a31-4421-9369-2d84f4157093 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:21.930869 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cde68258-3a31-4421-9369-2d84f4157093 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1503 microversion: 2.1 time: 0.396677 May 26 13:46:21.934160 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 136/272] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:21 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1503 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:22.546048 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e9ca0a71-5894-4bfa-b48a-d25f2de2392a tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0707a60>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:22.688343 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e9ca0a71-5894-4bfa-b48a-d25f2de2392a tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 352 microversion: 2.1 time: 0.146210 May 26 13:46:22.689140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 137/273] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:22 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 352 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:46:22.776070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f8ba03f5-1086-4f21-b0da-8a71e77f7ba5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:22.777010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f8ba03f5-1086-4f21-b0da-8a71e77f7ba5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:22.791944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8ba03f5-1086-4f21-b0da-8a71e77f7ba5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:22.791944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8ba03f5-1086-4f21-b0da-8a71e77f7ba5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:22.791944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8ba03f5-1086-4f21-b0da-8a71e77f7ba5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:22.792261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8ba03f5-1086-4f21-b0da-8a71e77f7ba5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:22.952024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f3fd0a46-1d66-483d-b657-6521a02a217c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:22.952786 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f3fd0a46-1d66-483d-b657-6521a02a217c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:22.974153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f3fd0a46-1d66-483d-b657-6521a02a217c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:22.974612 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f3fd0a46-1d66-483d-b657-6521a02a217c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:22.975430 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f3fd0a46-1d66-483d-b657-6521a02a217c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:22.975876 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f3fd0a46-1d66-483d-b657-6521a02a217c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:23.064598 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f8ba03f5-1086-4f21-b0da-8a71e77f7ba5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:23.083479 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f8ba03f5-1086-4f21-b0da-8a71e77f7ba5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.311367 May 26 13:46:23.101393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 137/274] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:22 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:23.359597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f3fd0a46-1d66-483d-b657-6521a02a217c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:23.377178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f3fd0a46-1d66-483d-b657-6521a02a217c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1503 microversion: 2.1 time: 0.428259 May 26 13:46:23.380169 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 138/275] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:22 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1503 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:23.706657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0ae82a0a-1808-4800-952a-ff7c001715a0 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0e839d0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:23.844072 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0ae82a0a-1808-4800-952a-ff7c001715a0 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 353 microversion: 2.1 time: 0.144264 May 26 13:46:23.853049 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 138/276] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:23 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:23.862573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8544303e-a6ba-44aa-8188-cc1e0e62757e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0707ee0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:23.954185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8544303e-a6ba-44aa-8188-cc1e0e62757e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 353 microversion: 2.1 time: 0.098302 May 26 13:46:23.957009 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 139/277] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:23 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:23.973699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1b982894-ae3c-46e1-9cd2-113f3d10dc24 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0eac1f0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:24.100096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1b982894-ae3c-46e1-9cd2-113f3d10dc24 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 202 len: 0 microversion: 2.1 time: 0.129650 May 26 13:46:24.102625 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 139/278] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:46:23 2022] DELETE /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:46:24.110353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fd2d6f3f-e575-4a85-af16-235fadb2ba49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:24.111320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fd2d6f3f-e575-4a85-af16-235fadb2ba49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:24.121224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cce1c081-4cda-4442-b02c-5ac188c004b3 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0eac8b0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:24.123900 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fd2d6f3f-e575-4a85-af16-235fadb2ba49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:24.124596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fd2d6f3f-e575-4a85-af16-235fadb2ba49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:24.125733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fd2d6f3f-e575-4a85-af16-235fadb2ba49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:24.126386 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fd2d6f3f-e575-4a85-af16-235fadb2ba49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:24.213639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cce1c081-4cda-4442-b02c-5ac188c004b3 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 352 microversion: 2.1 time: 0.105201 May 26 13:46:24.214196 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 140/279] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:24 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:24.347275 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-84cdfccc-48c8-4959-9ed5-fd46415724ef req-13ce207c-b44f-4b43-8668-065a3bc31291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1", "name": "network-vif-deleted", "tag": "16b9a0f5-441f-49b0-90d7-fb4d546e3615"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:24.394135 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-84cdfccc-48c8-4959-9ed5-fd46415724ef req-13ce207c-b44f-4b43-8668-065a3bc31291 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:24.395159 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-84cdfccc-48c8-4959-9ed5-fd46415724ef req-13ce207c-b44f-4b43-8668-065a3bc31291 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:24.412987 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-84cdfccc-48c8-4959-9ed5-fd46415724ef req-13ce207c-b44f-4b43-8668-065a3bc31291 service nova] Creating event network-vif-deleted:16b9a0f5-441f-49b0-90d7-fb4d546e3615 for instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 on hv-cinder-81966 May 26 13:46:24.419808 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-84cdfccc-48c8-4959-9ed5-fd46415724ef req-13ce207c-b44f-4b43-8668-065a3bc31291 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101149 May 26 13:46:24.421482 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 141/280] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:24.435220 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-92b3714a-91a7-4467-a3ec-368758e0e5ec tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:24.436451 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-92b3714a-91a7-4467-a3ec-368758e0e5ec tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:24.458318 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-92b3714a-91a7-4467-a3ec-368758e0e5ec tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:24.459117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-92b3714a-91a7-4467-a3ec-368758e0e5ec tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:24.460465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-92b3714a-91a7-4467-a3ec-368758e0e5ec tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:24.461529 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-92b3714a-91a7-4467-a3ec-368758e0e5ec tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:24.479505 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fd2d6f3f-e575-4a85-af16-235fadb2ba49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:24.492059 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fd2d6f3f-e575-4a85-af16-235fadb2ba49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.389135 May 26 13:46:24.493615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 140/281] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:24 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:24.625713 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-92b3714a-91a7-4467-a3ec-368758e0e5ec tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:24.631100 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:24.644372 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-92b3714a-91a7-4467-a3ec-368758e0e5ec tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1461 microversion: 2.1 time: 0.221396 May 26 13:46:24.646964 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 142/282] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:24 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1461 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:25.231565 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-56f0abee-fe6c-4ab4-b664-715d01ce2ea1 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e06303a0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:25.381188 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-56f0abee-fe6c-4ab4-b664-715d01ce2ea1 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 352 microversion: 2.1 time: 0.156546 May 26 13:46:25.382919 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 141/283] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:25 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:25.522790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-935189d2-75ae-402a-99a1-34daec2db5a4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:25.523565 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-935189d2-75ae-402a-99a1-34daec2db5a4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:25.530936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-935189d2-75ae-402a-99a1-34daec2db5a4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:25.531678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-935189d2-75ae-402a-99a1-34daec2db5a4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:25.532667 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-935189d2-75ae-402a-99a1-34daec2db5a4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:25.533269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-935189d2-75ae-402a-99a1-34daec2db5a4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:25.680509 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-56934b91-e3c5-4b4e-abf5-0249b9cd5dd6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:25.681449 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-56934b91-e3c5-4b4e-abf5-0249b9cd5dd6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:25.690933 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-56934b91-e3c5-4b4e-abf5-0249b9cd5dd6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:25.691625 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-56934b91-e3c5-4b4e-abf5-0249b9cd5dd6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:25.693065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-56934b91-e3c5-4b4e-abf5-0249b9cd5dd6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:25.693653 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-56934b91-e3c5-4b4e-abf5-0249b9cd5dd6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:25.807082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-56934b91-e3c5-4b4e-abf5-0249b9cd5dd6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:25.821865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-56934b91-e3c5-4b4e-abf5-0249b9cd5dd6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1461 microversion: 2.1 time: 0.149764 May 26 13:46:25.823643 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 142/284] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:25 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1461 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:25.893714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-935189d2-75ae-402a-99a1-34daec2db5a4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:25.907323 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-935189d2-75ae-402a-99a1-34daec2db5a4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.388453 May 26 13:46:25.940779 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 143/285] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:25 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:26.396350 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6294f528-bdeb-410d-949c-f3ecbde5589e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0630e50>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:26.513462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6294f528-bdeb-410d-949c-f3ecbde5589e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 352 microversion: 2.1 time: 0.122724 May 26 13:46:26.514056 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 143/286] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:26 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:26.839742 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-65a87760-e84b-494d-9f80-000812223d42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:26.840757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-65a87760-e84b-494d-9f80-000812223d42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:26.847774 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:26.850153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65a87760-e84b-494d-9f80-000812223d42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:26.850919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65a87760-e84b-494d-9f80-000812223d42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:26.852400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65a87760-e84b-494d-9f80-000812223d42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:26.852953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-65a87760-e84b-494d-9f80-000812223d42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:26.926215 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2fdaa54a-a63a-4a42-b878-bc708b7d753e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:26.927295 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2fdaa54a-a63a-4a42-b878-bc708b7d753e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:26.947786 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2fdaa54a-a63a-4a42-b878-bc708b7d753e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:26.948445 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2fdaa54a-a63a-4a42-b878-bc708b7d753e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:26.949365 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2fdaa54a-a63a-4a42-b878-bc708b7d753e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:26.952844 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2fdaa54a-a63a-4a42-b878-bc708b7d753e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:27.102179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-65a87760-e84b-494d-9f80-000812223d42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:27.119884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-65a87760-e84b-494d-9f80-000812223d42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1299 microversion: 2.1 time: 0.283919 May 26 13:46:27.124680 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 144/287] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:26 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1299 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:27.292487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2fdaa54a-a63a-4a42-b878-bc708b7d753e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:27.302990 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2fdaa54a-a63a-4a42-b878-bc708b7d753e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.381478 May 26 13:46:27.306559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 144/288] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:26 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:27.528413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-63e1a363-c00b-42f9-8113-57319a5b1f31 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0ea2a60>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:27.656245 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-63e1a363-c00b-42f9-8113-57319a5b1f31 tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 352 microversion: 2.1 time: 0.131582 May 26 13:46:27.657134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 145/289] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:27 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:28.137074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b8c2d40a-7786-4539-a59f-d965895b836e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:28.137737 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b8c2d40a-7786-4539-a59f-d965895b836e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:28.151534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b8c2d40a-7786-4539-a59f-d965895b836e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:28.152032 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b8c2d40a-7786-4539-a59f-d965895b836e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:28.153252 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b8c2d40a-7786-4539-a59f-d965895b836e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:28.159906 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b8c2d40a-7786-4539-a59f-d965895b836e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:28.326115 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eaee2a46-3452-42fe-857a-037dd367e903 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:28.326765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eaee2a46-3452-42fe-857a-037dd367e903 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:28.339665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eaee2a46-3452-42fe-857a-037dd367e903 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:28.340120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eaee2a46-3452-42fe-857a-037dd367e903 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:28.340936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eaee2a46-3452-42fe-857a-037dd367e903 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:28.341370 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eaee2a46-3452-42fe-857a-037dd367e903 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:28.349220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b8c2d40a-7786-4539-a59f-d965895b836e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:28.379658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b8c2d40a-7786-4539-a59f-d965895b836e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1299 microversion: 2.1 time: 0.245954 May 26 13:46:28.388415 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 145/290] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:28 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:28.669789 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-abfa38c1-0627-4f46-a29f-67ae078f5def tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e08399d0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:28.687550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eaee2a46-3452-42fe-857a-037dd367e903 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:28.718204 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eaee2a46-3452-42fe-857a-037dd367e903 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.397270 May 26 13:46:28.720270 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 146/291] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:28 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:28.758876 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-abfa38c1-0627-4f46-a29f-67ae078f5def tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 200 len: 352 microversion: 2.1 time: 0.092817 May 26 13:46:28.759595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 146/292] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:28 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:46:29.407853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:29.408564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:29.441117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:29.444989 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:29.448260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:29.449674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:29.522924 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:29.523743 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:29.524598 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lazy-loading 'fault' on Instance uuid 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:46:29.642358 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:29.665139 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-004cd039-673c-4070-9c8e-55d963ceaae3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 200 len: 1304 microversion: 2.1 time: 0.261544 May 26 13:46:29.669836 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 147/293] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:29 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 1304 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:29.742002 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-52d82e00-476c-499c-a31f-da5a9f1ce3ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:29.743651 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-52d82e00-476c-499c-a31f-da5a9f1ce3ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:29.776928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-52d82e00-476c-499c-a31f-da5a9f1ce3ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:29.778444 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-52d82e00-476c-499c-a31f-da5a9f1ce3ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:29.779692 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-52d82e00-476c-499c-a31f-da5a9f1ce3ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:29.780604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c8ecf0f-c7a7-4f35-bc2b-00e24541e38e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Calling method '.version_select at 0x7f07e0ea2550>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:29.780753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-52d82e00-476c-499c-a31f-da5a9f1ce3ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:29.843817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-5c8ecf0f-c7a7-4f35-bc2b-00e24541e38e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] HTTP exception thrown: Volume cf844b90-4a97-4c8e-bafb-904fd7fdb84b could not be found. May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c8ecf0f-c7a7-4f35-bc2b-00e24541e38e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Request method failure captured: May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b HTTP/1.1 May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4SsZHRsv_dXXsh6OiBOeG5UlmEst4MtGQfp5ThrweBU53e2Kk5BCjXZg1qnNxa8l0oID0m5tJPd2kIDuxufb9IxZ58eUkHrIXzTj4jK_LLUg4b_3w-X94LMSOiDGeD4HHSzp0rtvV6cAU3bypOA1NZS0xIDaHXbq7CZSIaSDs60NxQ May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: be0426d85d7e4579ab010001c0efff74 May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesGetTestJSON-1360320853 May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:46:29.847705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_be0426d85d7e4579ab010001c0efff74", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/be0426d85d7e4579ab010001c0efff74"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be0426d85d7e4579ab010001c0efff74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/be0426d85d7e4579ab010001c0efff74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesGetTestJSON-1360320853 May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: be0426d85d7e4579ab010001c0efff74 May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesGetTestJSON-1360320853 May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesGetTestJSON-1360320853-project May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 4dae7ca96d8d42428b6dc3d783385764 May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesGetTestJSON-1360320853-project May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Volume cf844b90-4a97-4c8e-bafb-904fd7fdb84b could not be found. May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'cf844b90-4a97-4c8e-bafb-904fd7fdb84b'} May 26 13:46:29.849304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cf844b90-4a97-4c8e-bafb-904fd7fdb84b could not be found. (HTTP 404) (Request-ID: req-09575352-d76b-4c64-9ce9-057385d8372b) May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:29.850017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:46:29.851095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cf844b90-4a97-4c8e-bafb-904fd7fdb84b could not be found. May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 13:46:29.852320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cf844b90-4a97-4c8e-bafb-904fd7fdb84b could not be found. May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cf844b90-4a97-4c8e-bafb-904fd7fdb84b could not be found. May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c8ecf0f-c7a7-4f35-bc2b-00e24541e38e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] Returning 404 to user: Volume cf844b90-4a97-4c8e-bafb-904fd7fdb84b could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c8ecf0f-c7a7-4f35-bc2b-00e24541e38e tempest-VolumesGetTestJSON-1360320853 tempest-VolumesGetTestJSON-1360320853-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b" status: 404 len: 109 microversion: 2.1 time: 0.081864 May 26 13:46:29.853350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 148/294] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:46:29 2022] GET /compute/v2.1/os-volumes/cf844b90-4a97-4c8e-bafb-904fd7fdb84b => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:46:30.112292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-52d82e00-476c-499c-a31f-da5a9f1ce3ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:30.125149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-52d82e00-476c-499c-a31f-da5a9f1ce3ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.390266 May 26 13:46:30.125954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 147/295] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:29 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:30.693885 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:30.694691 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:30.716436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:30.717191 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:30.718533 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:30.720075 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:30.768365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] HTTP exception thrown: Instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 could not be found. May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Request method failure captured: May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 HTTP/1.1 May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4R5RvC1wOenrKmxZrR-oarY5hCJIsTNgCuc25kbQA502Oj8AhPZbVTTpwAXtVw5QnEYP6vpb-2SiVgX9yM_txwDTwhh8TWdPdmDd7wbtM8JIAQIu-Pu2wGt0MYPJ2i_-pf0YzhrwfLrJQeG26OmWjeT5kHJhyFE1NlYkWEZJiQ51_g May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: c879e95c508f401fbc77e63b1e64dd16 May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesActionsTest-2054095430 May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:46:30.773961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c879e95c508f401fbc77e63b1e64dd16", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c879e95c508f401fbc77e63b1e64dd16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c879e95c508f401fbc77e63b1e64dd16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c879e95c508f401fbc77e63b1e64dd16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesActionsTest-2054095430 May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: c879e95c508f401fbc77e63b1e64dd16 May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesActionsTest-2054095430 May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesActionsTest-2054095430-project May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 6f7edee75b2845e6bbfbc64574691fb0 May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesActionsTest-2054095430-project May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 could not be found. May 26 13:46:30.775280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1'} May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 could not be found. May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:46:30.776074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 could not be found. May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 could not be found. May 26 13:46:30.777306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:46:30.780421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Returning 404 to user: Instance 2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:46:30.784558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-31b80f0f-405a-424c-8a0c-5eda9aa4569d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1" status: 404 len: 111 microversion: 2.1 time: 0.099186 May 26 13:46:30.789973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 149/296] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:30 2022] GET /compute/v2.1/servers/2af484b4-ccdb-4dad-bb6f-eecd0af2f1a1 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:46:31.037126 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1802962383", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "networks": [{"uuid": "ed6e76ad-8a60-4553-9a4f-125f6a59cade"}]}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:31.143404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6824ed89-02d0-43fb-a238-e03b07d5aa59 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:31.145999 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6824ed89-02d0-43fb-a238-e03b07d5aa59 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:31.159051 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.network.neutron [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] validate_networks() for [('ed6e76ad-8a60-4553-9a4f-125f6a59cade', None, None, None, None, None)] {{(pid=124240) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:46:31.160264 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6824ed89-02d0-43fb-a238-e03b07d5aa59 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:31.162375 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6824ed89-02d0-43fb-a238-e03b07d5aa59 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:31.165268 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6824ed89-02d0-43fb-a238-e03b07d5aa59 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:31.166800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6824ed89-02d0-43fb-a238-e03b07d5aa59 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:31.818421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6824ed89-02d0-43fb-a238-e03b07d5aa59 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:31.838378 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6824ed89-02d0-43fb-a238-e03b07d5aa59 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.698980 May 26 13:46:31.841888 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 150/297] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:31 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:32.227172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Flavor limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:46:32.228595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Image limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:46:32.229552 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Flavor pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:46:32.230197 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Image pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:46:32.231083 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:46:32.253809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:32.256268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:32.264618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:32.267242 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:32.298812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:32.317782 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Getting quotas for project c879e95c508f401fbc77e63b1e64dd16. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:46:32.326907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Getting quotas for user 6f7edee75b2845e6bbfbc64574691fb0 and project c879e95c508f401fbc77e63b1e64dd16. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:46:32.365861 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Going to run 1 instances... {{(pid=124240) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:46:32.380951 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:46:32.553171 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3053723f-f493-4205-982c-b2845b7cae6b tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.519170 May 26 13:46:32.559011 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 148/298] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:46:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:46:32.564629 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-72d200b1-d1fa-4948-814c-4953481f58dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:32.565327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-72d200b1-d1fa-4948-814c-4953481f58dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:32.861557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9f1840a3-044a-4198-a21f-cb6e7afeec37 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:32.862700 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9f1840a3-044a-4198-a21f-cb6e7afeec37 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:32.890990 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9f1840a3-044a-4198-a21f-cb6e7afeec37 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:32.891153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9f1840a3-044a-4198-a21f-cb6e7afeec37 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:32.891868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9f1840a3-044a-4198-a21f-cb6e7afeec37 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:32.893010 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9f1840a3-044a-4198-a21f-cb6e7afeec37 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:33.127094 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-72d200b1-d1fa-4948-814c-4953481f58dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:33.152439 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-72d200b1-d1fa-4948-814c-4953481f58dc tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1214 microversion: 2.1 time: 0.591134 May 26 13:46:33.154190 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 151/299] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:32 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1214 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:33.342094 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9f1840a3-044a-4198-a21f-cb6e7afeec37 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:33.360153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9f1840a3-044a-4198-a21f-cb6e7afeec37 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.504293 May 26 13:46:33.361765 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 149/300] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:32 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:34.007395 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-115ab9ce-2d2b-4155-83c1-f605654bc924 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Action: 'create', calling method: .version_select at 0x7f07e0e56820>, body: {"keypair": {"name": "tempest-TestShelveInstance-2123729586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7SbPwu/791IkLa9dpCGX8tzdPvcqpFPYJyiXbE4/2nf0yZ3418vLFTQoJM1EkvGnVRcCKUhRTm3vcBUZ6+0qiAoPH6UeSgADA8MFpJBzraeyQ5ipPCUdgST9fdzjCusg=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:34.096194 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-115ab9ce-2d2b-4155-83c1-f605654bc924 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Getting quotas for project c85800d659ab43ff9b16266f9f037fc2. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:46:34.116392 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-115ab9ce-2d2b-4155-83c1-f605654bc924 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Getting quotas for user bdb847efec494be8a5a89da456f54d3d and project c85800d659ab43ff9b16266f9f037fc2. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:46:34.174134 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dd287859-6e48-48fe-a989-94cc99bf42c0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:34.174762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dd287859-6e48-48fe-a989-94cc99bf42c0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:34.186038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dd287859-6e48-48fe-a989-94cc99bf42c0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:34.186790 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dd287859-6e48-48fe-a989-94cc99bf42c0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:34.187905 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dd287859-6e48-48fe-a989-94cc99bf42c0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:34.188550 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dd287859-6e48-48fe-a989-94cc99bf42c0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:34.198298 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-115ab9ce-2d2b-4155-83c1-f605654bc924 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.902719 May 26 13:46:34.199514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 152/301] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:46:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:46:34.326251 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dd287859-6e48-48fe-a989-94cc99bf42c0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:34.344775 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dd287859-6e48-48fe-a989-94cc99bf42c0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1266 microversion: 2.1 time: 0.178123 May 26 13:46:34.347078 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 150/302] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:34 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:34.388409 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b6177878-a0be-4228-8cd2-7ec8637964ca tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:34.389020 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b6177878-a0be-4228-8cd2-7ec8637964ca tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:34.400394 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6177878-a0be-4228-8cd2-7ec8637964ca tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:34.400903 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6177878-a0be-4228-8cd2-7ec8637964ca tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:34.401618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6177878-a0be-4228-8cd2-7ec8637964ca tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:34.402052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6177878-a0be-4228-8cd2-7ec8637964ca tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:35.151301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b6177878-a0be-4228-8cd2-7ec8637964ca tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:35.164415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b6177878-a0be-4228-8cd2-7ec8637964ca tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.779287 May 26 13:46:35.169360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 153/303] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:34 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:35.362800 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bf1ba784-a77d-49ab-b758-597624de004d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:35.363583 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bf1ba784-a77d-49ab-b758-597624de004d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:35.367045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:35.384389 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bf1ba784-a77d-49ab-b758-597624de004d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:35.384851 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bf1ba784-a77d-49ab-b758-597624de004d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:35.386952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bf1ba784-a77d-49ab-b758-597624de004d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:35.387399 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bf1ba784-a77d-49ab-b758-597624de004d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:35.546783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bf1ba784-a77d-49ab-b758-597624de004d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:35.560960 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bf1ba784-a77d-49ab-b758-597624de004d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1272 microversion: 2.1 time: 0.197265 May 26 13:46:35.561315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 151/304] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:35 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:36.186237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0d25e637-5426-4fcb-a512-396446c87f91 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:36.186902 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0d25e637-5426-4fcb-a512-396446c87f91 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:36.195941 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d25e637-5426-4fcb-a512-396446c87f91 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:36.197582 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d25e637-5426-4fcb-a512-396446c87f91 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:36.198381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d25e637-5426-4fcb-a512-396446c87f91 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:36.198814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d25e637-5426-4fcb-a512-396446c87f91 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:36.448009 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0d25e637-5426-4fcb-a512-396446c87f91 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:36.461575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0d25e637-5426-4fcb-a512-396446c87f91 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.275563 May 26 13:46:36.463033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 154/305] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:36 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:36.578217 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d1a253af-faa9-403b-a8e2-25da78bb405a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:36.580284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d1a253af-faa9-403b-a8e2-25da78bb405a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:36.606576 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d1a253af-faa9-403b-a8e2-25da78bb405a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:36.608067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d1a253af-faa9-403b-a8e2-25da78bb405a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:36.611853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d1a253af-faa9-403b-a8e2-25da78bb405a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:36.614436 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d1a253af-faa9-403b-a8e2-25da78bb405a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:36.885627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d1a253af-faa9-403b-a8e2-25da78bb405a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:36.898438 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d1a253af-faa9-403b-a8e2-25da78bb405a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1272 microversion: 2.1 time: 0.320849 May 26 13:46:36.910603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 152/306] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:36 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:37.480854 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1d2bab88-a042-417d-9c41-fa2e7af41f4b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:37.481374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1d2bab88-a042-417d-9c41-fa2e7af41f4b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:37.491726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d2bab88-a042-417d-9c41-fa2e7af41f4b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:37.495116 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d2bab88-a042-417d-9c41-fa2e7af41f4b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:37.496147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d2bab88-a042-417d-9c41-fa2e7af41f4b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:37.496913 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1d2bab88-a042-417d-9c41-fa2e7af41f4b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:37.919054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5f0922ee-3da2-4acf-ab61-797b1c62fb88 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:37.920229 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5f0922ee-3da2-4acf-ab61-797b1c62fb88 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:37.931186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f0922ee-3da2-4acf-ab61-797b1c62fb88 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:37.931925 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f0922ee-3da2-4acf-ab61-797b1c62fb88 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:37.932819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1d2bab88-a042-417d-9c41-fa2e7af41f4b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:37.935581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f0922ee-3da2-4acf-ab61-797b1c62fb88 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:37.936028 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f0922ee-3da2-4acf-ab61-797b1c62fb88 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:37.947409 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1d2bab88-a042-417d-9c41-fa2e7af41f4b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.470143 May 26 13:46:37.949752 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 155/307] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:37 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:38.304929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5f0922ee-3da2-4acf-ab61-797b1c62fb88 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:38.314374 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5f0922ee-3da2-4acf-ab61-797b1c62fb88 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.402851 May 26 13:46:38.326003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 153/308] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:37 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:38.969767 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9a9f2d1e-5800-4eb0-b70f-79571f96c13e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:38.971089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9a9f2d1e-5800-4eb0-b70f-79571f96c13e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:39.001154 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a9f2d1e-5800-4eb0-b70f-79571f96c13e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:39.005088 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a9f2d1e-5800-4eb0-b70f-79571f96c13e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:39.007670 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a9f2d1e-5800-4eb0-b70f-79571f96c13e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:39.009494 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a9f2d1e-5800-4eb0-b70f-79571f96c13e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:39.333974 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-402c5367-5354-4f58-81a7-d483af1a89e5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:39.335430 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-402c5367-5354-4f58-81a7-d483af1a89e5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:39.374801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-402c5367-5354-4f58-81a7-d483af1a89e5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:39.375655 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-402c5367-5354-4f58-81a7-d483af1a89e5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:39.381391 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-402c5367-5354-4f58-81a7-d483af1a89e5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:39.382082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-402c5367-5354-4f58-81a7-d483af1a89e5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:39.627574 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9a9f2d1e-5800-4eb0-b70f-79571f96c13e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:39.650419 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9a9f2d1e-5800-4eb0-b70f-79571f96c13e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.682031 May 26 13:46:39.651471 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 156/309] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:38 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:40.152018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-05a1f846-39f3-4127-9fff-e6f09eeef24e req-453645bc-e2b8-4de8-8321-5bedd1dd52d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "460c9c68-cb94-4868-833a-0c18408bf8a1", "tag": "f01ed1d1-5ed3-41f8-b751-42c8524c1067"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:40.228373 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-05a1f846-39f3-4127-9fff-e6f09eeef24e req-453645bc-e2b8-4de8-8321-5bedd1dd52d8 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:40.234554 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-05a1f846-39f3-4127-9fff-e6f09eeef24e req-453645bc-e2b8-4de8-8321-5bedd1dd52d8 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:40.273465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-05a1f846-39f3-4127-9fff-e6f09eeef24e req-453645bc-e2b8-4de8-8321-5bedd1dd52d8 service nova] Creating event network-changed:f01ed1d1-5ed3-41f8-b751-42c8524c1067 for instance 460c9c68-cb94-4868-833a-0c18408bf8a1 on hv-cinder-81966 May 26 13:46:40.297214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-05a1f846-39f3-4127-9fff-e6f09eeef24e req-453645bc-e2b8-4de8-8321-5bedd1dd52d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147873 May 26 13:46:40.301972 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 157/310] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:40.351741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-402c5367-5354-4f58-81a7-d483af1a89e5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:40.374350 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-402c5367-5354-4f58-81a7-d483af1a89e5 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 1.045184 May 26 13:46:40.387204 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 154/311] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:39 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:40.670874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f404fdfb-2824-42f6-a0ef-084a64fb6e1f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:40.672979 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f404fdfb-2824-42f6-a0ef-084a64fb6e1f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:40.686899 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f404fdfb-2824-42f6-a0ef-084a64fb6e1f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:40.687904 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f404fdfb-2824-42f6-a0ef-084a64fb6e1f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:40.689155 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f404fdfb-2824-42f6-a0ef-084a64fb6e1f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:40.690118 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f404fdfb-2824-42f6-a0ef-084a64fb6e1f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:41.020480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f404fdfb-2824-42f6-a0ef-084a64fb6e1f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:41.032264 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f404fdfb-2824-42f6-a0ef-084a64fb6e1f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.366066 May 26 13:46:41.032991 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 158/312] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:40 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:41.400428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7911971b-9cd2-46e3-8410-2cb8c4ed49bb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:41.401253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7911971b-9cd2-46e3-8410-2cb8c4ed49bb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:41.414858 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7911971b-9cd2-46e3-8410-2cb8c4ed49bb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:41.415315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7911971b-9cd2-46e3-8410-2cb8c4ed49bb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:41.425057 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7911971b-9cd2-46e3-8410-2cb8c4ed49bb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:41.426336 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7911971b-9cd2-46e3-8410-2cb8c4ed49bb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:41.653367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7911971b-9cd2-46e3-8410-2cb8c4ed49bb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:41.665431 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7911971b-9cd2-46e3-8410-2cb8c4ed49bb tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.275683 May 26 13:46:41.666713 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 155/313] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:41 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:42.068088 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-01403852-6fba-4613-896c-18cdc6e8ca74 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:42.070581 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-01403852-6fba-4613-896c-18cdc6e8ca74 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:42.091520 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01403852-6fba-4613-896c-18cdc6e8ca74 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:42.092651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01403852-6fba-4613-896c-18cdc6e8ca74 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:42.096562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01403852-6fba-4613-896c-18cdc6e8ca74 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:42.098771 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01403852-6fba-4613-896c-18cdc6e8ca74 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:42.392027 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-01403852-6fba-4613-896c-18cdc6e8ca74 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:42.405427 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-01403852-6fba-4613-896c-18cdc6e8ca74 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.355596 May 26 13:46:42.407543 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 159/314] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:42 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:42.682967 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-089afb90-ef41-48a9-88c9-6bd501c550f6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:42.683836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-089afb90-ef41-48a9-88c9-6bd501c550f6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:42.686153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:42.688102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=6 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:42.727210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-089afb90-ef41-48a9-88c9-6bd501c550f6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:42.727738 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-089afb90-ef41-48a9-88c9-6bd501c550f6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:42.728584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-089afb90-ef41-48a9-88c9-6bd501c550f6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:42.729027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-089afb90-ef41-48a9-88c9-6bd501c550f6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:43.119750 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-089afb90-ef41-48a9-88c9-6bd501c550f6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:43.153345 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-089afb90-ef41-48a9-88c9-6bd501c550f6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.471112 May 26 13:46:43.172203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 156/315] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:42 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:43.424357 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7f94c983-4e44-42e3-897c-ae2288e09bfb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:43.425044 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7f94c983-4e44-42e3-897c-ae2288e09bfb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:43.431921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f94c983-4e44-42e3-897c-ae2288e09bfb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:43.435420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f94c983-4e44-42e3-897c-ae2288e09bfb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:43.437762 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f94c983-4e44-42e3-897c-ae2288e09bfb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:43.439285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f94c983-4e44-42e3-897c-ae2288e09bfb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:43.849041 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f94c983-4e44-42e3-897c-ae2288e09bfb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:43.858367 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7f94c983-4e44-42e3-897c-ae2288e09bfb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.438881 May 26 13:46:43.864490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 160/316] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:43 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:44.185084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0219290c-7fc9-49fa-9806-42601fae89b6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:44.185833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0219290c-7fc9-49fa-9806-42601fae89b6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:44.215729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0219290c-7fc9-49fa-9806-42601fae89b6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:44.220983 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0219290c-7fc9-49fa-9806-42601fae89b6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:44.233470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0219290c-7fc9-49fa-9806-42601fae89b6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:44.234861 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0219290c-7fc9-49fa-9806-42601fae89b6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:44.836350 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0219290c-7fc9-49fa-9806-42601fae89b6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:44.870146 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0219290c-7fc9-49fa-9806-42601fae89b6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.687281 May 26 13:46:44.878925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a7b17350-2ddb-476c-91b1-dd8d16778ec2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:44.880278 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a7b17350-2ddb-476c-91b1-dd8d16778ec2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:44.880835 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 157/317] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:44 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:44.883733 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:44.931287 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7b17350-2ddb-476c-91b1-dd8d16778ec2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:44.931671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7b17350-2ddb-476c-91b1-dd8d16778ec2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:44.932542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7b17350-2ddb-476c-91b1-dd8d16778ec2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:44.940147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a7b17350-2ddb-476c-91b1-dd8d16778ec2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:45.896697 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1f370e3b-8b04-4b1e-a31f-52f605f7857a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:45.897990 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1f370e3b-8b04-4b1e-a31f-52f605f7857a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:45.912284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f370e3b-8b04-4b1e-a31f-52f605f7857a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:45.913022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f370e3b-8b04-4b1e-a31f-52f605f7857a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:45.915585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f370e3b-8b04-4b1e-a31f-52f605f7857a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:45.920617 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f370e3b-8b04-4b1e-a31f-52f605f7857a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:46.456733 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a7b17350-2ddb-476c-91b1-dd8d16778ec2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:46.464798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a7b17350-2ddb-476c-91b1-dd8d16778ec2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 1.590182 May 26 13:46:46.475199 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 161/318] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:44 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:46.612255 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1f370e3b-8b04-4b1e-a31f-52f605f7857a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:46.623513 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1f370e3b-8b04-4b1e-a31f-52f605f7857a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.732923 May 26 13:46:46.630966 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 158/319] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:45 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:47.486702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f59dceed-af4a-4d5a-bb5f-2ccadee38264 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:47.489227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f59dceed-af4a-4d5a-bb5f-2ccadee38264 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:47.500852 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f59dceed-af4a-4d5a-bb5f-2ccadee38264 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:47.502106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f59dceed-af4a-4d5a-bb5f-2ccadee38264 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:47.505464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f59dceed-af4a-4d5a-bb5f-2ccadee38264 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:47.506127 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f59dceed-af4a-4d5a-bb5f-2ccadee38264 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:47.648609 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3a4a2cfc-2cc5-4b30-bfa5-82d27d355c91 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:47.650304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3a4a2cfc-2cc5-4b30-bfa5-82d27d355c91 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:47.665852 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3a4a2cfc-2cc5-4b30-bfa5-82d27d355c91 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:47.667861 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3a4a2cfc-2cc5-4b30-bfa5-82d27d355c91 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:47.669805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3a4a2cfc-2cc5-4b30-bfa5-82d27d355c91 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:47.672674 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3a4a2cfc-2cc5-4b30-bfa5-82d27d355c91 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:47.765559 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f59dceed-af4a-4d5a-bb5f-2ccadee38264 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:47.780928 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f59dceed-af4a-4d5a-bb5f-2ccadee38264 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.299100 May 26 13:46:47.782991 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 162/320] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:47 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:48.075897 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3a4a2cfc-2cc5-4b30-bfa5-82d27d355c91 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:48.090383 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3a4a2cfc-2cc5-4b30-bfa5-82d27d355c91 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.445363 May 26 13:46:48.092085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 159/321] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:47 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:48.799538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b839bad3-8b59-44ec-abad-7f9774c5ae4c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:48.800912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b839bad3-8b59-44ec-abad-7f9774c5ae4c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:48.812059 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b839bad3-8b59-44ec-abad-7f9774c5ae4c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:48.823485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b839bad3-8b59-44ec-abad-7f9774c5ae4c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:48.826415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b839bad3-8b59-44ec-abad-7f9774c5ae4c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:48.826840 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b839bad3-8b59-44ec-abad-7f9774c5ae4c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:49.117901 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-06c1c74e-b223-41ab-865c-00a5ddd9f126 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:49.119259 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-06c1c74e-b223-41ab-865c-00a5ddd9f126 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:49.139860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-06c1c74e-b223-41ab-865c-00a5ddd9f126 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:49.140334 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-06c1c74e-b223-41ab-865c-00a5ddd9f126 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:49.141137 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-06c1c74e-b223-41ab-865c-00a5ddd9f126 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:49.141577 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-06c1c74e-b223-41ab-865c-00a5ddd9f126 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:49.235218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b839bad3-8b59-44ec-abad-7f9774c5ae4c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:49.253459 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b839bad3-8b59-44ec-abad-7f9774c5ae4c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.457918 May 26 13:46:49.265341 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 163/322] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:48 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:49.477862 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-06c1c74e-b223-41ab-865c-00a5ddd9f126 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:49.491064 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-06c1c74e-b223-41ab-865c-00a5ddd9f126 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.387618 May 26 13:46:49.502979 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 160/323] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:49 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:49.776729 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-465d7c78-0938-4cbb-a9ed-16d4f5dc0b1b req-71ba0b7b-918f-4a9e-8844-86ba77137232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "460c9c68-cb94-4868-833a-0c18408bf8a1", "name": "network-vif-plugged", "status": "completed", "tag": "f01ed1d1-5ed3-41f8-b751-42c8524c1067"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:49.790878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-465d7c78-0938-4cbb-a9ed-16d4f5dc0b1b req-71ba0b7b-918f-4a9e-8844-86ba77137232 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:49.791311 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-465d7c78-0938-4cbb-a9ed-16d4f5dc0b1b req-71ba0b7b-918f-4a9e-8844-86ba77137232 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:49.810806 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-465d7c78-0938-4cbb-a9ed-16d4f5dc0b1b req-71ba0b7b-918f-4a9e-8844-86ba77137232 service nova] Creating event network-vif-plugged:f01ed1d1-5ed3-41f8-b751-42c8524c1067 for instance 460c9c68-cb94-4868-833a-0c18408bf8a1 on hv-cinder-81966 May 26 13:46:49.820892 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-465d7c78-0938-4cbb-a9ed-16d4f5dc0b1b req-71ba0b7b-918f-4a9e-8844-86ba77137232 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047268 May 26 13:46:49.823610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 164/324] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:50.273291 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7dd4f4d2-7a17-4013-b247-aeb322dff087 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:50.274151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7dd4f4d2-7a17-4013-b247-aeb322dff087 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:50.287542 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7dd4f4d2-7a17-4013-b247-aeb322dff087 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:50.288185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7dd4f4d2-7a17-4013-b247-aeb322dff087 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:50.289054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7dd4f4d2-7a17-4013-b247-aeb322dff087 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:50.289493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7dd4f4d2-7a17-4013-b247-aeb322dff087 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:50.510316 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4ca374ef-d04e-43b7-a28c-c3b947bde58f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:50.511359 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4ca374ef-d04e-43b7-a28c-c3b947bde58f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:50.523257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ca374ef-d04e-43b7-a28c-c3b947bde58f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:50.524351 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ca374ef-d04e-43b7-a28c-c3b947bde58f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:50.525908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ca374ef-d04e-43b7-a28c-c3b947bde58f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:50.526832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ca374ef-d04e-43b7-a28c-c3b947bde58f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:50.536663 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:50.581758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7dd4f4d2-7a17-4013-b247-aeb322dff087 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:50.592553 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7dd4f4d2-7a17-4013-b247-aeb322dff087 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.325093 May 26 13:46:50.593674 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 161/325] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:50 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:50.789096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4ca374ef-d04e-43b7-a28c-c3b947bde58f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:50.811608 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4ca374ef-d04e-43b7-a28c-c3b947bde58f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.306451 May 26 13:46:50.826681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 165/326] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:50 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:51.609755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ad7bc1dc-92e2-4ed3-8c51-5c3884445a53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:51.610542 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ad7bc1dc-92e2-4ed3-8c51-5c3884445a53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:51.623898 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ad7bc1dc-92e2-4ed3-8c51-5c3884445a53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:51.626067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ad7bc1dc-92e2-4ed3-8c51-5c3884445a53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:51.627054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ad7bc1dc-92e2-4ed3-8c51-5c3884445a53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:51.627552 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ad7bc1dc-92e2-4ed3-8c51-5c3884445a53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:51.825119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ad7bc1dc-92e2-4ed3-8c51-5c3884445a53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:51.834730 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0d516861-e4b2-43ca-96a8-05f920c39810 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:51.835424 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0d516861-e4b2-43ca-96a8-05f920c39810 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:51.840203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ad7bc1dc-92e2-4ed3-8c51-5c3884445a53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.234520 May 26 13:46:51.851601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 162/327] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:51 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:51.853299 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d516861-e4b2-43ca-96a8-05f920c39810 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:51.853762 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d516861-e4b2-43ca-96a8-05f920c39810 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:51.854552 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d516861-e4b2-43ca-96a8-05f920c39810 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:51.855174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0d516861-e4b2-43ca-96a8-05f920c39810 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:52.053974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0d516861-e4b2-43ca-96a8-05f920c39810 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:52.062239 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0d516861-e4b2-43ca-96a8-05f920c39810 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.232489 May 26 13:46:52.072824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 166/328] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:51 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:52.858997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ff439b99-05ee-4501-9cbe-c490c95c91f5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:52.860365 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ff439b99-05ee-4501-9cbe-c490c95c91f5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:52.867702 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff439b99-05ee-4501-9cbe-c490c95c91f5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:52.868146 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff439b99-05ee-4501-9cbe-c490c95c91f5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:52.869244 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff439b99-05ee-4501-9cbe-c490c95c91f5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:52.869930 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff439b99-05ee-4501-9cbe-c490c95c91f5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:53.065221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ff439b99-05ee-4501-9cbe-c490c95c91f5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:53.074125 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ff439b99-05ee-4501-9cbe-c490c95c91f5 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.218894 May 26 13:46:53.074725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 163/329] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:52 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:53.080647 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bfe53d4a-354d-48d2-bbd2-01da9d0a3666 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:53.082196 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bfe53d4a-354d-48d2-bbd2-01da9d0a3666 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:53.096272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bfe53d4a-354d-48d2-bbd2-01da9d0a3666 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:53.096798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bfe53d4a-354d-48d2-bbd2-01da9d0a3666 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:53.098144 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bfe53d4a-354d-48d2-bbd2-01da9d0a3666 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:53.100652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bfe53d4a-354d-48d2-bbd2-01da9d0a3666 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:53.283360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bfe53d4a-354d-48d2-bbd2-01da9d0a3666 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:53.292739 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bfe53d4a-354d-48d2-bbd2-01da9d0a3666 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.215969 May 26 13:46:53.293418 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 167/330] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:53 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:54.095453 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1e4a0379-03b6-4d43-b45e-153e8cd41267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:54.096154 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1e4a0379-03b6-4d43-b45e-153e8cd41267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:54.116707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1e4a0379-03b6-4d43-b45e-153e8cd41267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:54.116707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1e4a0379-03b6-4d43-b45e-153e8cd41267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:54.116707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1e4a0379-03b6-4d43-b45e-153e8cd41267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:54.116707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1e4a0379-03b6-4d43-b45e-153e8cd41267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:54.263941 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1e4a0379-03b6-4d43-b45e-153e8cd41267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:54.273468 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1e4a0379-03b6-4d43-b45e-153e8cd41267 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.181455 May 26 13:46:54.274190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 164/331] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:54 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:54.311741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fd7b2767-b986-4760-86d2-ac1fe32fdc6c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:54.312477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fd7b2767-b986-4760-86d2-ac1fe32fdc6c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:54.318990 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd7b2767-b986-4760-86d2-ac1fe32fdc6c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:54.319433 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd7b2767-b986-4760-86d2-ac1fe32fdc6c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:54.320214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd7b2767-b986-4760-86d2-ac1fe32fdc6c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:54.320686 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd7b2767-b986-4760-86d2-ac1fe32fdc6c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:54.480966 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fd7b2767-b986-4760-86d2-ac1fe32fdc6c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:54.489620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fd7b2767-b986-4760-86d2-ac1fe32fdc6c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.182315 May 26 13:46:54.490202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 168/332] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:54 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:55.299419 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d0675692-af66-4c49-8114-0141549f3d6e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:55.301403 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d0675692-af66-4c49-8114-0141549f3d6e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:55.310659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d0675692-af66-4c49-8114-0141549f3d6e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:55.311497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d0675692-af66-4c49-8114-0141549f3d6e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:55.313014 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d0675692-af66-4c49-8114-0141549f3d6e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:55.313558 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d0675692-af66-4c49-8114-0141549f3d6e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:55.344731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:55.508970 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d0675692-af66-4c49-8114-0141549f3d6e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:55.513228 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ebc02eff-be93-410f-b981-f264f781acb8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:55.514003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ebc02eff-be93-410f-b981-f264f781acb8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:55.519788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d0675692-af66-4c49-8114-0141549f3d6e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.232594 May 26 13:46:55.520411 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 165/333] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:55 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:55.530030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ebc02eff-be93-410f-b981-f264f781acb8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:55.530782 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ebc02eff-be93-410f-b981-f264f781acb8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:55.532230 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ebc02eff-be93-410f-b981-f264f781acb8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:55.536248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ebc02eff-be93-410f-b981-f264f781acb8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:55.717150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ebc02eff-be93-410f-b981-f264f781acb8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:55.726875 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ebc02eff-be93-410f-b981-f264f781acb8 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.219276 May 26 13:46:55.736163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 169/334] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:55 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:56.539904 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6f6b00b0-8f37-44f8-9bc4-92e6571d7173 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:56.540670 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6f6b00b0-8f37-44f8-9bc4-92e6571d7173 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:56.555151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6f6b00b0-8f37-44f8-9bc4-92e6571d7173 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:56.559058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6f6b00b0-8f37-44f8-9bc4-92e6571d7173 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:56.560012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6f6b00b0-8f37-44f8-9bc4-92e6571d7173 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:56.560522 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6f6b00b0-8f37-44f8-9bc4-92e6571d7173 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:56.738293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6f6b00b0-8f37-44f8-9bc4-92e6571d7173 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:56.746168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6f6b00b0-8f37-44f8-9bc4-92e6571d7173 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.210768 May 26 13:46:56.756441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 166/335] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:56 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:56.763247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0b11435a-1a3d-4957-ab18-80eecfcd5336 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:56.764389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0b11435a-1a3d-4957-ab18-80eecfcd5336 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:56.773047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b11435a-1a3d-4957-ab18-80eecfcd5336 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:56.773597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b11435a-1a3d-4957-ab18-80eecfcd5336 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:56.774452 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b11435a-1a3d-4957-ab18-80eecfcd5336 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:56.775027 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b11435a-1a3d-4957-ab18-80eecfcd5336 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:56.977992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0b11435a-1a3d-4957-ab18-80eecfcd5336 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:56.988008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b9b702cf-c7c5-470a-aa34-be9424e4acd4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Action: 'create', calling method: .version_select at 0x7f07e05d03a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1245478232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpWBilg+S94mb9PhtujVR6chwnhQqzf/cZwvFzfQQ4lb2GdYoeo2G6rCQBmOHxs4W3GCVf9sSdf8MylOJoiJyNGhcMaTITWr4PA5sGeWEkxbTPDZ7GIltAb8kaRUARFQQ=="}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:56.988451 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0b11435a-1a3d-4957-ab18-80eecfcd5336 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.230633 May 26 13:46:56.989265 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 170/336] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:56 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:57.004280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-b9b702cf-c7c5-470a-aa34-be9424e4acd4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Getting quotas for project c70c0ab9b5134d0781dea0e0abc02ac8. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:46:57.009061 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-b9b702cf-c7c5-470a-aa34-be9424e4acd4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Getting quotas for user 5b0a34631db94d1d9fd5e865de5b9156 and project c70c0ab9b5134d0781dea0e0abc02ac8. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:46:57.032926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b9b702cf-c7c5-470a-aa34-be9424e4acd4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049106 May 26 13:46:57.033446 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 167/337] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:46:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:46:57.163372 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-58347713", "imageRef": "ef1f25f7-0ad2-466c-95ec-63fbc6b3ed9a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1245478232", "networks": [{"uuid": "279221b5-1c95-41d9-af88-4e2c4d2e3a32"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:46:57.170308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:46:57.222067 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] validate_networks() for [('279221b5-1c95-41d9-af88-4e2c4d2e3a32', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:46:57.646576 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:46:57.647070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:46:57.647563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:46:57.648107 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:46:57.648566 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:46:57.660350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:57.660801 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:57.661593 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:57.662266 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:57.681410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Getting quotas for project c70c0ab9b5134d0781dea0e0abc02ac8. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:46:57.685982 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Getting quotas for user 5b0a34631db94d1d9fd5e865de5b9156 and project c70c0ab9b5134d0781dea0e0abc02ac8. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:46:57.699278 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:46:57.701622 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef1f25f7-0ad2-466c-95ec-63fbc6b3ed9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:46:57.755892 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6ec988f0-df7c-4f08-a83c-bb73032aafdb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597534 May 26 13:46:57.757269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 171/338] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:46:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 13:46:57.768748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-269a31fd-c810-43bb-84e0-3e5c349dee3d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:57.770253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-269a31fd-c810-43bb-84e0-3e5c349dee3d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:57.773317 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-488e018a-fc91-4977-b35c-e68966cc8a44 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:57.775764 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-488e018a-fc91-4977-b35c-e68966cc8a44 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:57.777439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-269a31fd-c810-43bb-84e0-3e5c349dee3d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:57.778194 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-269a31fd-c810-43bb-84e0-3e5c349dee3d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:57.779728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-269a31fd-c810-43bb-84e0-3e5c349dee3d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:57.780415 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-269a31fd-c810-43bb-84e0-3e5c349dee3d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:57.885326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-488e018a-fc91-4977-b35c-e68966cc8a44 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:57.899204 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-488e018a-fc91-4977-b35c-e68966cc8a44 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1257 microversion: 2.1 time: 0.135220 May 26 13:46:57.900182 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 172/339] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:57 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1257 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:57.997787 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-269a31fd-c810-43bb-84e0-3e5c349dee3d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:58.005860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-269a31fd-c810-43bb-84e0-3e5c349dee3d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.242678 May 26 13:46:58.015254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 168/340] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:57 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:58.015610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-857518b1-b5cd-4c8a-8a58-4c5856984ab1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:58.015610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-857518b1-b5cd-4c8a-8a58-4c5856984ab1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:58.015814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-857518b1-b5cd-4c8a-8a58-4c5856984ab1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:58.016145 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-857518b1-b5cd-4c8a-8a58-4c5856984ab1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:58.017056 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-857518b1-b5cd-4c8a-8a58-4c5856984ab1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:58.017420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-857518b1-b5cd-4c8a-8a58-4c5856984ab1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:58.252033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-857518b1-b5cd-4c8a-8a58-4c5856984ab1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:58.274363 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-857518b1-b5cd-4c8a-8a58-4c5856984ab1 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1314 microversion: 2.1 time: 0.272471 May 26 13:46:58.288516 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 173/341] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:58 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:58.919389 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5ce3a488-cc4e-491e-8b56-f23b69b15586 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:58.920038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5ce3a488-cc4e-491e-8b56-f23b69b15586 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:58.927050 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ce3a488-cc4e-491e-8b56-f23b69b15586 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:58.927498 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ce3a488-cc4e-491e-8b56-f23b69b15586 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:58.928270 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ce3a488-cc4e-491e-8b56-f23b69b15586 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:58.928803 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ce3a488-cc4e-491e-8b56-f23b69b15586 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:58.994709 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5ce3a488-cc4e-491e-8b56-f23b69b15586 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:59.002879 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5ce3a488-cc4e-491e-8b56-f23b69b15586 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1261 microversion: 2.1 time: 0.087278 May 26 13:46:59.003644 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 169/342] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:58 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:46:59.023856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0a1af6f9-9191-4d4e-8cc6-78b54e7f4849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:59.024671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0a1af6f9-9191-4d4e-8cc6-78b54e7f4849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:59.031252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a1af6f9-9191-4d4e-8cc6-78b54e7f4849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:59.031702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a1af6f9-9191-4d4e-8cc6-78b54e7f4849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:59.032542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a1af6f9-9191-4d4e-8cc6-78b54e7f4849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:59.032978 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0a1af6f9-9191-4d4e-8cc6-78b54e7f4849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:59.178975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0a1af6f9-9191-4d4e-8cc6-78b54e7f4849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:59.186716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0a1af6f9-9191-4d4e-8cc6-78b54e7f4849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1519 microversion: 2.1 time: 0.167053 May 26 13:46:59.187375 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 174/343] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:59 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:46:59.292743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c0bbe0e5-0d75-44e5-b733-1ece1f709800 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:46:59.293214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c0bbe0e5-0d75-44e5-b733-1ece1f709800 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:46:59.300479 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0bbe0e5-0d75-44e5-b733-1ece1f709800 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:59.301149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0bbe0e5-0d75-44e5-b733-1ece1f709800 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:59.301934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0bbe0e5-0d75-44e5-b733-1ece1f709800 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:46:59.302369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0bbe0e5-0d75-44e5-b733-1ece1f709800 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:46:59.450625 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c0bbe0e5-0d75-44e5-b733-1ece1f709800 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:46:59.459640 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c0bbe0e5-0d75-44e5-b733-1ece1f709800 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1497 microversion: 2.1 time: 0.170841 May 26 13:46:59.460414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 170/344] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:46:59 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:00.022411 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ad5b9c41-168d-4701-90cb-ae1bebd9d179 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:00.023555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ad5b9c41-168d-4701-90cb-ae1bebd9d179 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:00.031361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ad5b9c41-168d-4701-90cb-ae1bebd9d179 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.032006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ad5b9c41-168d-4701-90cb-ae1bebd9d179 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.038316 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ad5b9c41-168d-4701-90cb-ae1bebd9d179 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.040867 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ad5b9c41-168d-4701-90cb-ae1bebd9d179 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.130180 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ad5b9c41-168d-4701-90cb-ae1bebd9d179 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:00.140425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ad5b9c41-168d-4701-90cb-ae1bebd9d179 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1309 microversion: 2.1 time: 0.123104 May 26 13:47:00.141009 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 175/345] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:00 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1309 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:00.170298 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-51c121bd-6fa4-4aaf-8399-51a3281116ab tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:00.170864 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-51c121bd-6fa4-4aaf-8399-51a3281116ab tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:00.178187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51c121bd-6fa4-4aaf-8399-51a3281116ab tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.178187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51c121bd-6fa4-4aaf-8399-51a3281116ab tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.178187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51c121bd-6fa4-4aaf-8399-51a3281116ab tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.178187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51c121bd-6fa4-4aaf-8399-51a3281116ab tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.204128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7f1ee3ae-a068-4905-9305-be7ef7560aaf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:00.204768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7f1ee3ae-a068-4905-9305-be7ef7560aaf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:00.206276 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-51c121bd-6fa4-4aaf-8399-51a3281116ab tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:47:00.211300 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f1ee3ae-a068-4905-9305-be7ef7560aaf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.211815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f1ee3ae-a068-4905-9305-be7ef7560aaf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.212662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f1ee3ae-a068-4905-9305-be7ef7560aaf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.213053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f1ee3ae-a068-4905-9305-be7ef7560aaf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.312733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-51c121bd-6fa4-4aaf-8399-51a3281116ab tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "DELETE /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 204 len: 0 microversion: 2.1 time: 0.145457 May 26 13:47:00.313593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 171/346] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:47:00 2022] DELETE /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:47:00.325239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-376ca38c-6f10-443a-aaa8-b3b0bff4442f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:00.326328 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-376ca38c-6f10-443a-aaa8-b3b0bff4442f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:00.336043 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-376ca38c-6f10-443a-aaa8-b3b0bff4442f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.336538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-376ca38c-6f10-443a-aaa8-b3b0bff4442f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.337367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-376ca38c-6f10-443a-aaa8-b3b0bff4442f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.337831 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-376ca38c-6f10-443a-aaa8-b3b0bff4442f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.384517 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f1ee3ae-a068-4905-9305-be7ef7560aaf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:00.393983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7f1ee3ae-a068-4905-9305-be7ef7560aaf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1499 microversion: 2.1 time: 0.192979 May 26 13:47:00.394952 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 176/347] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:00 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1499 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:00.411854 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5e483ac2-7ebe-46a2-b628-a1369bcc6223 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:00.412572 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5e483ac2-7ebe-46a2-b628-a1369bcc6223 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:00.418577 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e483ac2-7ebe-46a2-b628-a1369bcc6223 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.419020 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e483ac2-7ebe-46a2-b628-a1369bcc6223 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.419781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e483ac2-7ebe-46a2-b628-a1369bcc6223 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:00.420211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e483ac2-7ebe-46a2-b628-a1369bcc6223 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:00.486634 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-376ca38c-6f10-443a-aaa8-b3b0bff4442f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:00.499135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-376ca38c-6f10-443a-aaa8-b3b0bff4442f tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1503 microversion: 2.1 time: 0.180490 May 26 13:47:00.499739 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 172/348] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:00 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:00.656589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e483ac2-7ebe-46a2-b628-a1369bcc6223 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:00.665678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5e483ac2-7ebe-46a2-b628-a1369bcc6223 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1513 microversion: 2.1 time: 0.258388 May 26 13:47:00.666718 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 177/349] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:00 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:01.156874 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-727e8b4c-7a7a-48bd-b3fa-dfacf5644d84 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:01.157558 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-727e8b4c-7a7a-48bd-b3fa-dfacf5644d84 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:01.163712 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-727e8b4c-7a7a-48bd-b3fa-dfacf5644d84 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:01.164280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-727e8b4c-7a7a-48bd-b3fa-dfacf5644d84 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:01.165259 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-727e8b4c-7a7a-48bd-b3fa-dfacf5644d84 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:01.165807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-727e8b4c-7a7a-48bd-b3fa-dfacf5644d84 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:01.235684 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-727e8b4c-7a7a-48bd-b3fa-dfacf5644d84 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:01.244167 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-727e8b4c-7a7a-48bd-b3fa-dfacf5644d84 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1317 microversion: 2.1 time: 0.091165 May 26 13:47:01.244796 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 173/350] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:01 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1317 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:01.516953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-939bd1e6-d185-4a24-97f1-1ddbeac303fa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:01.517725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-939bd1e6-d185-4a24-97f1-1ddbeac303fa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:01.523833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-939bd1e6-d185-4a24-97f1-1ddbeac303fa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:01.524283 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-939bd1e6-d185-4a24-97f1-1ddbeac303fa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:01.525085 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-939bd1e6-d185-4a24-97f1-1ddbeac303fa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:01.525522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-939bd1e6-d185-4a24-97f1-1ddbeac303fa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:01.777225 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-939bd1e6-d185-4a24-97f1-1ddbeac303fa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:01.788029 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-939bd1e6-d185-4a24-97f1-1ddbeac303fa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1503 microversion: 2.1 time: 0.274989 May 26 13:47:01.788918 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 178/351] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:01 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:02.271069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0c307a68-b78b-4909-9015-408f3e2b0a56 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:02.272140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0c307a68-b78b-4909-9015-408f3e2b0a56 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:02.313895 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c307a68-b78b-4909-9015-408f3e2b0a56 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:02.314759 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c307a68-b78b-4909-9015-408f3e2b0a56 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:02.318239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c307a68-b78b-4909-9015-408f3e2b0a56 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:02.320169 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c307a68-b78b-4909-9015-408f3e2b0a56 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:02.809973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a2ad7057-5a85-42b1-b3cb-8f24be6f8c14 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:02.811269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a2ad7057-5a85-42b1-b3cb-8f24be6f8c14 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:02.829796 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2ad7057-5a85-42b1-b3cb-8f24be6f8c14 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:02.831084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2ad7057-5a85-42b1-b3cb-8f24be6f8c14 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:02.832882 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2ad7057-5a85-42b1-b3cb-8f24be6f8c14 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:02.833548 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2ad7057-5a85-42b1-b3cb-8f24be6f8c14 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:02.897422 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0c307a68-b78b-4909-9015-408f3e2b0a56 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:02.905854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0c307a68-b78b-4909-9015-408f3e2b0a56 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.645854 May 26 13:47:02.917171 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 174/352] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:02 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:03.176723 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-adffcd93-15da-4b4c-9a46-77819a5e6efa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:03.177752 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-adffcd93-15da-4b4c-9a46-77819a5e6efa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:03.189666 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-adffcd93-15da-4b4c-9a46-77819a5e6efa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:03.190608 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-adffcd93-15da-4b4c-9a46-77819a5e6efa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:03.194442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-adffcd93-15da-4b4c-9a46-77819a5e6efa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:03.194903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-adffcd93-15da-4b4c-9a46-77819a5e6efa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:03.252997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-adffcd93-15da-4b4c-9a46-77819a5e6efa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lazy-loading 'flavor' on Instance uuid c6527206-c7a2-4458-97ed-915ee9b16cfb {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:47:03.346825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a2ad7057-5a85-42b1-b3cb-8f24be6f8c14 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:03.365877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a2ad7057-5a85-42b1-b3cb-8f24be6f8c14 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1503 microversion: 2.1 time: 0.563071 May 26 13:47:03.371934 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 179/353] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:02 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1503 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:03.574383 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-adffcd93-15da-4b4c-9a46-77819a5e6efa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb/action" status: 200 len: 32 microversion: 2.1 time: 0.401839 May 26 13:47:03.581582 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 175/354] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:47:03 2022] POST /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb/action => generated 32 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 13:47:03.587416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bb3a2e13-3d04-4db0-8296-b701be32e754 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:03.588048 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bb3a2e13-3d04-4db0-8296-b701be32e754 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:03.606823 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-ccd535c5-b5b3-497f-ad30-c5b030fe9a2f req-a5a571ef-451b-46ca-93ef-bfa2825f9546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "460c9c68-cb94-4868-833a-0c18408bf8a1", "name": "network-vif-deleted", "tag": "f01ed1d1-5ed3-41f8-b751-42c8524c1067"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:03.617918 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb3a2e13-3d04-4db0-8296-b701be32e754 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:03.630203 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb3a2e13-3d04-4db0-8296-b701be32e754 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:03.636520 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb3a2e13-3d04-4db0-8296-b701be32e754 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:03.638052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bb3a2e13-3d04-4db0-8296-b701be32e754 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:03.650120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-ccd535c5-b5b3-497f-ad30-c5b030fe9a2f req-a5a571ef-451b-46ca-93ef-bfa2825f9546 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:03.655343 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-ccd535c5-b5b3-497f-ad30-c5b030fe9a2f req-a5a571ef-451b-46ca-93ef-bfa2825f9546 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:03.707060 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-ccd535c5-b5b3-497f-ad30-c5b030fe9a2f req-a5a571ef-451b-46ca-93ef-bfa2825f9546 service nova] Creating event network-vif-deleted:f01ed1d1-5ed3-41f8-b751-42c8524c1067 for instance 460c9c68-cb94-4868-833a-0c18408bf8a1 on hv-cinder-81966 May 26 13:47:03.715915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-ccd535c5-b5b3-497f-ad30-c5b030fe9a2f req-a5a571ef-451b-46ca-93ef-bfa2825f9546 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113575 May 26 13:47:03.717045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 176/355] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:47:03.860898 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-e63efc70-ed03-48d5-833e-09a6775c55c2 req-7c9090d4-b9a9-4ef2-93c8-c89ceff822b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ad193e-1516-41cd-8603-74830f1c6fc7", "tag": "e0662874-78ce-4387-a824-8ab106baa767"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:03.888220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e63efc70-ed03-48d5-833e-09a6775c55c2 req-7c9090d4-b9a9-4ef2-93c8-c89ceff822b9 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:03.901385 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e63efc70-ed03-48d5-833e-09a6775c55c2 req-7c9090d4-b9a9-4ef2-93c8-c89ceff822b9 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:03.948412 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-e63efc70-ed03-48d5-833e-09a6775c55c2 req-7c9090d4-b9a9-4ef2-93c8-c89ceff822b9 service nova] Creating event network-changed:e0662874-78ce-4387-a824-8ab106baa767 for instance 39ad193e-1516-41cd-8603-74830f1c6fc7 on hv-cinder-81966 May 26 13:47:03.977788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-e63efc70-ed03-48d5-833e-09a6775c55c2 req-7c9090d4-b9a9-4ef2-93c8-c89ceff822b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121257 May 26 13:47:03.979095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 177/356] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:47:03.988277 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0b33da46-a763-4f95-b448-615699261758 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:03.989323 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0b33da46-a763-4f95-b448-615699261758 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:04.045746 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0b33da46-a763-4f95-b448-615699261758 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:04.050032 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0b33da46-a763-4f95-b448-615699261758 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.048s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:04.053571 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0b33da46-a763-4f95-b448-615699261758 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:04.055990 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0b33da46-a763-4f95-b448-615699261758 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:04.058456 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bb3a2e13-3d04-4db0-8296-b701be32e754 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:04.068591 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bb3a2e13-3d04-4db0-8296-b701be32e754 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.485362 May 26 13:47:04.078369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 180/357] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:03 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:04.396191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0b33da46-a763-4f95-b448-615699261758 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:04.397258 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-41985032-5e72-47e8-aa72-3818cdb7db2c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:04.400001 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-41985032-5e72-47e8-aa72-3818cdb7db2c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:04.406470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0b33da46-a763-4f95-b448-615699261758 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.425612 May 26 13:47:04.411775 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 178/358] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:03 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:04.428967 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41985032-5e72-47e8-aa72-3818cdb7db2c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:04.429984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41985032-5e72-47e8-aa72-3818cdb7db2c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:04.431294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41985032-5e72-47e8-aa72-3818cdb7db2c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:04.432011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41985032-5e72-47e8-aa72-3818cdb7db2c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:04.550566 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-41985032-5e72-47e8-aa72-3818cdb7db2c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:04.572042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-41985032-5e72-47e8-aa72-3818cdb7db2c tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.189312 May 26 13:47:04.573115 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 181/359] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:04 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:05.089950 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-21887d7d-485f-44aa-91fd-1fd8ef9dab0d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:05.091101 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-21887d7d-485f-44aa-91fd-1fd8ef9dab0d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:05.099429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-21887d7d-485f-44aa-91fd-1fd8ef9dab0d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:05.099889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-21887d7d-485f-44aa-91fd-1fd8ef9dab0d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:05.100911 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-21887d7d-485f-44aa-91fd-1fd8ef9dab0d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:05.101968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-21887d7d-485f-44aa-91fd-1fd8ef9dab0d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:05.329717 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-21887d7d-485f-44aa-91fd-1fd8ef9dab0d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:05.338457 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-21887d7d-485f-44aa-91fd-1fd8ef9dab0d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.253536 May 26 13:47:05.339662 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 179/360] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:05 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:05.430025 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f22e1c4b-4ef1-46fa-a0da-09f57823c973 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:05.432116 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f22e1c4b-4ef1-46fa-a0da-09f57823c973 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:05.448670 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f22e1c4b-4ef1-46fa-a0da-09f57823c973 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:05.450442 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f22e1c4b-4ef1-46fa-a0da-09f57823c973 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:05.451609 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f22e1c4b-4ef1-46fa-a0da-09f57823c973 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:05.452808 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f22e1c4b-4ef1-46fa-a0da-09f57823c973 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:05.607864 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2f2cc559-4672-46f1-996e-926d103707da tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:05.609012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2f2cc559-4672-46f1-996e-926d103707da tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:05.617127 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:05.635414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2f2cc559-4672-46f1-996e-926d103707da tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:05.636156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2f2cc559-4672-46f1-996e-926d103707da tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:05.644588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2f2cc559-4672-46f1-996e-926d103707da tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:05.646058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2f2cc559-4672-46f1-996e-926d103707da tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:05.718104 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f22e1c4b-4ef1-46fa-a0da-09f57823c973 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:05.729183 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f22e1c4b-4ef1-46fa-a0da-09f57823c973 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.306502 May 26 13:47:05.733747 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 182/361] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:05 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:05.961223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2f2cc559-4672-46f1-996e-926d103707da tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:05.975353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:05.981593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2f2cc559-4672-46f1-996e-926d103707da tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.382593 May 26 13:47:05.983269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 180/362] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:05 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:06.367474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fd628cdb-a4cf-4579-9fd9-49f0a2942817 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:06.368506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fd628cdb-a4cf-4579-9fd9-49f0a2942817 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:06.388860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd628cdb-a4cf-4579-9fd9-49f0a2942817 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:06.390046 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd628cdb-a4cf-4579-9fd9-49f0a2942817 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:06.391142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd628cdb-a4cf-4579-9fd9-49f0a2942817 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:06.393621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd628cdb-a4cf-4579-9fd9-49f0a2942817 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:06.431384 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:06.627915 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fd628cdb-a4cf-4579-9fd9-49f0a2942817 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:06.641233 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fd628cdb-a4cf-4579-9fd9-49f0a2942817 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.279249 May 26 13:47:06.641823 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 183/363] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:06 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:06.751869 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-09fb7371-9693-4dea-85c5-53b949f3dcb2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:06.753729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-09fb7371-9693-4dea-85c5-53b949f3dcb2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:06.772733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09fb7371-9693-4dea-85c5-53b949f3dcb2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:06.773217 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09fb7371-9693-4dea-85c5-53b949f3dcb2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:06.774003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09fb7371-9693-4dea-85c5-53b949f3dcb2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:06.774439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-09fb7371-9693-4dea-85c5-53b949f3dcb2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:06.974908 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-09fb7371-9693-4dea-85c5-53b949f3dcb2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:06.987445 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-09fb7371-9693-4dea-85c5-53b949f3dcb2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.239080 May 26 13:47:06.989015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 181/364] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:06 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:07.005776 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0432ebc6-69af-4565-bd3c-9cf4def7d0cf tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:07.006652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0432ebc6-69af-4565-bd3c-9cf4def7d0cf tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:07.014084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0432ebc6-69af-4565-bd3c-9cf4def7d0cf tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:07.014562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0432ebc6-69af-4565-bd3c-9cf4def7d0cf tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:07.015512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0432ebc6-69af-4565-bd3c-9cf4def7d0cf tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:07.015958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0432ebc6-69af-4565-bd3c-9cf4def7d0cf tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:07.165398 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0432ebc6-69af-4565-bd3c-9cf4def7d0cf tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:07.188589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0432ebc6-69af-4565-bd3c-9cf4def7d0cf tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.188956 May 26 13:47:07.196506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 184/365] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:06 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:07.667257 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c63ecd83-b983-4bec-94cf-e181b9ecd191 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:07.669143 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c63ecd83-b983-4bec-94cf-e181b9ecd191 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:07.672211 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=4 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:07.682333 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c63ecd83-b983-4bec-94cf-e181b9ecd191 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:07.683248 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c63ecd83-b983-4bec-94cf-e181b9ecd191 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:07.684835 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c63ecd83-b983-4bec-94cf-e181b9ecd191 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:07.685758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c63ecd83-b983-4bec-94cf-e181b9ecd191 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:08.013415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fab2dee4-b6e8-4315-a5b9-93731a02add5 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:08.014314 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fab2dee4-b6e8-4315-a5b9-93731a02add5 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:08.036791 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c63ecd83-b983-4bec-94cf-e181b9ecd191 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:08.043114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:08.045681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=8 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:08.062078 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fab2dee4-b6e8-4315-a5b9-93731a02add5 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:08.065717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fab2dee4-b6e8-4315-a5b9-93731a02add5 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:08.066978 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fab2dee4-b6e8-4315-a5b9-93731a02add5 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:08.068647 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fab2dee4-b6e8-4315-a5b9-93731a02add5 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:08.073090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c63ecd83-b983-4bec-94cf-e181b9ecd191 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.415640 May 26 13:47:08.074496 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 182/366] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:07 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:08.107316 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1513923734", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2123729586", "security_groups": [{"name": "tempest-secgroup-smoke-1386823348"}], "networks": [{"uuid": "0478328b-202e-4fb7-84c6-c736725d6bdc"}], "block_device_mapping_v2": [{"uuid": "b7d1c5ec-2676-41cf-b4fb-9ffdbbe810cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:08.385188 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fab2dee4-b6e8-4315-a5b9-93731a02add5 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:08.399716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fab2dee4-b6e8-4315-a5b9-93731a02add5 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.391622 May 26 13:47:08.400760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 185/367] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:08 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:08.423410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-95ba381e-ee12-4397-966d-514d54997a42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:08.429589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-95ba381e-ee12-4397-966d-514d54997a42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:08.441042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95ba381e-ee12-4397-966d-514d54997a42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:08.441850 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95ba381e-ee12-4397-966d-514d54997a42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:08.443308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95ba381e-ee12-4397-966d-514d54997a42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:08.444104 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-95ba381e-ee12-4397-966d-514d54997a42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:08.457262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.network.neutron [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] validate_networks() for [('0478328b-202e-4fb7-84c6-c736725d6bdc', None, None, None, None, None)] {{(pid=124240) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:47:08.556908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-95ba381e-ee12-4397-966d-514d54997a42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:08.567153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-95ba381e-ee12-4397-966d-514d54997a42 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.164766 May 26 13:47:08.567802 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 186/368] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:08 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:09.098163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c095af6c-5e17-4ce2-ad20-7bdf254b7924 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:09.102687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Flavor limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:47:09.103222 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Image limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:47:09.104120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Flavor pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:47:09.104633 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Image pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:47:09.105169 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:47:09.105347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c095af6c-5e17-4ce2-ad20-7bdf254b7924 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:09.113763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c095af6c-5e17-4ce2-ad20-7bdf254b7924 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:09.114607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c095af6c-5e17-4ce2-ad20-7bdf254b7924 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:09.115597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c095af6c-5e17-4ce2-ad20-7bdf254b7924 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:09.116198 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c095af6c-5e17-4ce2-ad20-7bdf254b7924 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:09.142425 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:09.143507 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:09.144887 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:09.145573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:09.204598 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Getting quotas for project c85800d659ab43ff9b16266f9f037fc2. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:47:09.210474 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Getting quotas for user bdb847efec494be8a5a89da456f54d3d and project c85800d659ab43ff9b16266f9f037fc2. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:47:09.355067 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c095af6c-5e17-4ce2-ad20-7bdf254b7924 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:09.364616 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c095af6c-5e17-4ce2-ad20-7bdf254b7924 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.276248 May 26 13:47:09.365490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 187/369] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:09 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:09.418169 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Going to run 1 instances... {{(pid=124240) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:47:09.420253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7d1c5ec-2676-41cf-b4fb-9ffdbbe810cb',volume_size=None,volume_type=None)] {{(pid=124240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:47:09.420646 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf2a7cf0-06ec-414d-ad64-019fceac7cab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:09.421415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf2a7cf0-06ec-414d-ad64-019fceac7cab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:09.437508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf2a7cf0-06ec-414d-ad64-019fceac7cab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:09.437508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf2a7cf0-06ec-414d-ad64-019fceac7cab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:09.437508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf2a7cf0-06ec-414d-ad64-019fceac7cab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:09.437508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf2a7cf0-06ec-414d-ad64-019fceac7cab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:09.665870 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bf2a7cf0-06ec-414d-ad64-019fceac7cab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:09.675507 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf2a7cf0-06ec-414d-ad64-019fceac7cab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.260935 May 26 13:47:09.677671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 188/370] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:09 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:09.696991 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc581da2-068e-404f-a74f-085419caff89 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:09.697831 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc581da2-068e-404f-a74f-085419caff89 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:09.716346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc581da2-068e-404f-a74f-085419caff89 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:09.716346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc581da2-068e-404f-a74f-085419caff89 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:09.716346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc581da2-068e-404f-a74f-085419caff89 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:09.716346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc581da2-068e-404f-a74f-085419caff89 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:09.836643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc581da2-068e-404f-a74f-085419caff89 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:09.849621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc581da2-068e-404f-a74f-085419caff89 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.170534 May 26 13:47:09.850274 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 189/371] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:09 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:09.947148 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a716bfb6-e80e-4e25-a2b6-4baacd4b8cae tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.870224 May 26 13:47:09.948503 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 183/372] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:47:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:47:09.964910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2c6f10a8-545a-47d0-8dbc-c3e016a823c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:09.968160 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2c6f10a8-545a-47d0-8dbc-c3e016a823c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:10.087980 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2c6f10a8-545a-47d0-8dbc-c3e016a823c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:10.096508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2c6f10a8-545a-47d0-8dbc-c3e016a823c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1089 microversion: 2.1 time: 0.139268 May 26 13:47:10.097437 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 190/373] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:09 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1089 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:10.383035 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-cc012af5-6f2f-4b9d-b30a-7c6af8f985a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:10.384135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-cc012af5-6f2f-4b9d-b30a-7c6af8f985a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:10.393047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cc012af5-6f2f-4b9d-b30a-7c6af8f985a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:10.397094 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cc012af5-6f2f-4b9d-b30a-7c6af8f985a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:10.398944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cc012af5-6f2f-4b9d-b30a-7c6af8f985a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:10.399576 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cc012af5-6f2f-4b9d-b30a-7c6af8f985a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:10.592914 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-cc012af5-6f2f-4b9d-b30a-7c6af8f985a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:10.602529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-cc012af5-6f2f-4b9d-b30a-7c6af8f985a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.223822 May 26 13:47:10.603523 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 184/374] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:10 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:10.703377 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f82c5d98-94c9-473d-a7a3-4476fb44a650 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:10.704156 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f82c5d98-94c9-473d-a7a3-4476fb44a650 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:10.713066 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f82c5d98-94c9-473d-a7a3-4476fb44a650 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:10.713066 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f82c5d98-94c9-473d-a7a3-4476fb44a650 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:10.714146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f82c5d98-94c9-473d-a7a3-4476fb44a650 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:10.714716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f82c5d98-94c9-473d-a7a3-4476fb44a650 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:10.872944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-557c7180-c5fb-4d47-b1ee-9197c058ba76 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:10.874441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-557c7180-c5fb-4d47-b1ee-9197c058ba76 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:10.882783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-557c7180-c5fb-4d47-b1ee-9197c058ba76 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:10.883621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-557c7180-c5fb-4d47-b1ee-9197c058ba76 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:10.884875 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-557c7180-c5fb-4d47-b1ee-9197c058ba76 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:10.885506 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-557c7180-c5fb-4d47-b1ee-9197c058ba76 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:10.890699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f82c5d98-94c9-473d-a7a3-4476fb44a650 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:10.901031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f82c5d98-94c9-473d-a7a3-4476fb44a650 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.201882 May 26 13:47:10.901741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 191/375] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:10 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:10.967882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-557c7180-c5fb-4d47-b1ee-9197c058ba76 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:10.973982 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-259304431", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:10.977582 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-557c7180-c5fb-4d47-b1ee-9197c058ba76 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.108989 May 26 13:47:10.978252 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 185/376] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:10 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:11.028526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] validate_networks() for None {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:47:11.115215 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1a490a55-eff2-4810-89de-f0376b905b35 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:11.116125 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1a490a55-eff2-4810-89de-f0376b905b35 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:11.125351 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1a490a55-eff2-4810-89de-f0376b905b35 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:11.126491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1a490a55-eff2-4810-89de-f0376b905b35 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:11.130982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1a490a55-eff2-4810-89de-f0376b905b35 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:11.132377 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1a490a55-eff2-4810-89de-f0376b905b35 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:11.206946 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1a490a55-eff2-4810-89de-f0376b905b35 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:11.215846 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1a490a55-eff2-4810-89de-f0376b905b35 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1139 microversion: 2.1 time: 0.105404 May 26 13:47:11.225437 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 186/377] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:11 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1139 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:11.582567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:47:11.582990 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:47:11.583456 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:47:11.583857 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:47:11.584260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:47:11.594187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:11.595016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:11.596043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:11.596390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:11.616132 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Getting quotas for project 7b4298aa065642c0bcfaed146905ce85. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:47:11.620407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8a8d92c9-7283-4993-a9cd-098f2715e49e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:11.621003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Getting quotas for user 2cd8ed5659b74354bd590f8fa2d5e19a and project 7b4298aa065642c0bcfaed146905ce85. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:47:11.621404 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8a8d92c9-7283-4993-a9cd-098f2715e49e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:11.628085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a8d92c9-7283-4993-a9cd-098f2715e49e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:11.629020 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a8d92c9-7283-4993-a9cd-098f2715e49e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:11.630379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a8d92c9-7283-4993-a9cd-098f2715e49e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:11.631085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a8d92c9-7283-4993-a9cd-098f2715e49e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:11.635385 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:47:11.639117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:47:11.698138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0460a675-39cb-4e5d-89e4-232b4f0b7d5b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732006 May 26 13:47:11.699130 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 192/378] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:47:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 13:47:11.709583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ad28c620-4d0a-4cb2-9264-943a9808e5c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:11.710456 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ad28c620-4d0a-4cb2-9264-943a9808e5c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:11.821904 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ad28c620-4d0a-4cb2-9264-943a9808e5c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:11.836724 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8a8d92c9-7283-4993-a9cd-098f2715e49e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:11.843096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ad28c620-4d0a-4cb2-9264-943a9808e5c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1214 microversion: 2.1 time: 0.133457 May 26 13:47:11.845245 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8a8d92c9-7283-4993-a9cd-098f2715e49e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.228814 May 26 13:47:11.856438 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 193/379] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:11 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:11.860531 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 187/380] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:11 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:11.926449 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-477fa167-9580-4fa2-a2a5-dd7a10b1ecec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:11.927052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-477fa167-9580-4fa2-a2a5-dd7a10b1ecec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:11.935340 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-477fa167-9580-4fa2-a2a5-dd7a10b1ecec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:11.935796 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-477fa167-9580-4fa2-a2a5-dd7a10b1ecec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:11.936728 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-477fa167-9580-4fa2-a2a5-dd7a10b1ecec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:11.937181 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-477fa167-9580-4fa2-a2a5-dd7a10b1ecec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.005123 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9b70a882-68f1-463f-a329-c237de5a746e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:12.006680 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9b70a882-68f1-463f-a329-c237de5a746e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:12.019354 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b70a882-68f1-463f-a329-c237de5a746e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:12.020565 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b70a882-68f1-463f-a329-c237de5a746e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.021979 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b70a882-68f1-463f-a329-c237de5a746e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:12.022982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b70a882-68f1-463f-a329-c237de5a746e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.116988 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9b70a882-68f1-463f-a329-c237de5a746e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:12.127261 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9b70a882-68f1-463f-a329-c237de5a746e tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.127800 May 26 13:47:12.128817 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 188/381] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:11 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:12.239058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c36438b2-ab76-457a-88f7-57a655be6c11 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:12.240676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c36438b2-ab76-457a-88f7-57a655be6c11 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:12.253600 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c36438b2-ab76-457a-88f7-57a655be6c11 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:12.254075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c36438b2-ab76-457a-88f7-57a655be6c11 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.254885 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c36438b2-ab76-457a-88f7-57a655be6c11 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:12.255518 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c36438b2-ab76-457a-88f7-57a655be6c11 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.258255 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-477fa167-9580-4fa2-a2a5-dd7a10b1ecec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:12.275315 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-477fa167-9580-4fa2-a2a5-dd7a10b1ecec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.352830 May 26 13:47:12.280951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 194/382] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:11 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:12.347524 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c36438b2-ab76-457a-88f7-57a655be6c11 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:12.362802 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c36438b2-ab76-457a-88f7-57a655be6c11 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1139 microversion: 2.1 time: 0.130500 May 26 13:47:12.363762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 189/383] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:12 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1139 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:12.863102 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-661d1fb6-8004-479a-9e61-bdeb388a74aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:12.863736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-661d1fb6-8004-479a-9e61-bdeb388a74aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:12.867527 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3aa00954-f33c-4b19-85f9-2058fa91d63e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:12.868214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3aa00954-f33c-4b19-85f9-2058fa91d63e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:12.870320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-661d1fb6-8004-479a-9e61-bdeb388a74aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:12.870769 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-661d1fb6-8004-479a-9e61-bdeb388a74aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.871588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-661d1fb6-8004-479a-9e61-bdeb388a74aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:12.872003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-661d1fb6-8004-479a-9e61-bdeb388a74aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.875362 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3aa00954-f33c-4b19-85f9-2058fa91d63e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:12.876074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3aa00954-f33c-4b19-85f9-2058fa91d63e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.877625 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3aa00954-f33c-4b19-85f9-2058fa91d63e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:12.878225 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3aa00954-f33c-4b19-85f9-2058fa91d63e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:12.949013 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-661d1fb6-8004-479a-9e61-bdeb388a74aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:12.957468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-661d1fb6-8004-479a-9e61-bdeb388a74aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1218 microversion: 2.1 time: 0.099033 May 26 13:47:12.958051 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 195/384] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:12 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:13.044111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3aa00954-f33c-4b19-85f9-2058fa91d63e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:13.053321 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3aa00954-f33c-4b19-85f9-2058fa91d63e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.190066 May 26 13:47:13.053912 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 190/385] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:12 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:13.153237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d554ecc8-4b1a-4037-8577-c84ee3e4b6aa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:13.154022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d554ecc8-4b1a-4037-8577-c84ee3e4b6aa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:13.161022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d554ecc8-4b1a-4037-8577-c84ee3e4b6aa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:13.162479 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d554ecc8-4b1a-4037-8577-c84ee3e4b6aa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:13.163668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d554ecc8-4b1a-4037-8577-c84ee3e4b6aa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:13.164263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d554ecc8-4b1a-4037-8577-c84ee3e4b6aa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:13.251142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d554ecc8-4b1a-4037-8577-c84ee3e4b6aa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:13.260239 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d554ecc8-4b1a-4037-8577-c84ee3e4b6aa tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.117492 May 26 13:47:13.261156 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 196/386] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:13 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:13.292709 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e8b6fde0-d904-4d63-832a-2b69f557b3ad tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:13.293539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e8b6fde0-d904-4d63-832a-2b69f557b3ad tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:13.300325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e8b6fde0-d904-4d63-832a-2b69f557b3ad tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:13.300862 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e8b6fde0-d904-4d63-832a-2b69f557b3ad tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:13.301715 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e8b6fde0-d904-4d63-832a-2b69f557b3ad tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:13.302339 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e8b6fde0-d904-4d63-832a-2b69f557b3ad tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:13.382970 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-754dd5bd-3604-4b2a-952d-0aaad9060bf9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:13.383603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-754dd5bd-3604-4b2a-952d-0aaad9060bf9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:13.390139 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-754dd5bd-3604-4b2a-952d-0aaad9060bf9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:13.390592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-754dd5bd-3604-4b2a-952d-0aaad9060bf9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:13.391378 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-754dd5bd-3604-4b2a-952d-0aaad9060bf9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:13.391805 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-754dd5bd-3604-4b2a-952d-0aaad9060bf9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:13.463170 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e8b6fde0-d904-4d63-832a-2b69f557b3ad tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:13.464496 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-754dd5bd-3604-4b2a-952d-0aaad9060bf9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:13.471331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e8b6fde0-d904-4d63-832a-2b69f557b3ad tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.182063 May 26 13:47:13.472166 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 191/387] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:13 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:13.472573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-754dd5bd-3604-4b2a-952d-0aaad9060bf9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1139 microversion: 2.1 time: 0.093521 May 26 13:47:13.473244 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 197/388] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:13 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:13.975209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-af8e9387-7e21-4d8b-a827-32f3d167a0aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:13.975804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-af8e9387-7e21-4d8b-a827-32f3d167a0aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:13.981868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-af8e9387-7e21-4d8b-a827-32f3d167a0aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:13.982312 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-af8e9387-7e21-4d8b-a827-32f3d167a0aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:13.983387 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-af8e9387-7e21-4d8b-a827-32f3d167a0aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:13.983533 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-af8e9387-7e21-4d8b-a827-32f3d167a0aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.050080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-af8e9387-7e21-4d8b-a827-32f3d167a0aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:14.058371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-af8e9387-7e21-4d8b-a827-32f3d167a0aa tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1218 microversion: 2.1 time: 0.087608 May 26 13:47:14.058955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 192/389] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:13 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:14.070874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a5c04155-c2fa-4acf-bb6f-de10c1ad7b9d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:14.071749 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a5c04155-c2fa-4acf-bb6f-de10c1ad7b9d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:14.078235 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5c04155-c2fa-4acf-bb6f-de10c1ad7b9d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:14.078672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5c04155-c2fa-4acf-bb6f-de10c1ad7b9d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.079435 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5c04155-c2fa-4acf-bb6f-de10c1ad7b9d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:14.079862 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a5c04155-c2fa-4acf-bb6f-de10c1ad7b9d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.220843 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a5c04155-c2fa-4acf-bb6f-de10c1ad7b9d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:14.228702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a5c04155-c2fa-4acf-bb6f-de10c1ad7b9d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.162447 May 26 13:47:14.229288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 198/390] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:14 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:14.277841 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e1109949-b684-444b-9eb8-3e8707600887 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:14.278612 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e1109949-b684-444b-9eb8-3e8707600887 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:14.285387 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e1109949-b684-444b-9eb8-3e8707600887 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:14.285913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e1109949-b684-444b-9eb8-3e8707600887 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.286761 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e1109949-b684-444b-9eb8-3e8707600887 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:14.287271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e1109949-b684-444b-9eb8-3e8707600887 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.354483 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e1109949-b684-444b-9eb8-3e8707600887 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:14.363333 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e1109949-b684-444b-9eb8-3e8707600887 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.089311 May 26 13:47:14.363931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 193/391] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:14 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:14.489438 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b4651976-4fca-4803-9cab-2921bfa8c03a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:14.490011 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e3ad0939-69eb-4937-bed4-a5aa93b548b1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:14.490230 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b4651976-4fca-4803-9cab-2921bfa8c03a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:14.490946 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e3ad0939-69eb-4937-bed4-a5aa93b548b1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:14.497191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e3ad0939-69eb-4937-bed4-a5aa93b548b1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:14.497563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4651976-4fca-4803-9cab-2921bfa8c03a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:14.497890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e3ad0939-69eb-4937-bed4-a5aa93b548b1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.498182 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4651976-4fca-4803-9cab-2921bfa8c03a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.498811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e3ad0939-69eb-4937-bed4-a5aa93b548b1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:14.499318 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e3ad0939-69eb-4937-bed4-a5aa93b548b1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.499426 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4651976-4fca-4803-9cab-2921bfa8c03a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:14.499811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b4651976-4fca-4803-9cab-2921bfa8c03a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:14.595460 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e3ad0939-69eb-4937-bed4-a5aa93b548b1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:14.605576 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e3ad0939-69eb-4937-bed4-a5aa93b548b1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1139 microversion: 2.1 time: 0.119939 May 26 13:47:14.614811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 194/392] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:14 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1139 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:14.666447 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b4651976-4fca-4803-9cab-2921bfa8c03a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:14.674932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b4651976-4fca-4803-9cab-2921bfa8c03a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.189684 May 26 13:47:14.675421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 199/393] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:14 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:15.075223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-421310d8-0b13-457c-b583-b86924107720 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:15.075829 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-421310d8-0b13-457c-b583-b86924107720 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:15.082387 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-421310d8-0b13-457c-b583-b86924107720 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.082836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-421310d8-0b13-457c-b583-b86924107720 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.083598 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-421310d8-0b13-457c-b583-b86924107720 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.084025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-421310d8-0b13-457c-b583-b86924107720 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.145422 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-421310d8-0b13-457c-b583-b86924107720 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:15.152794 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-421310d8-0b13-457c-b583-b86924107720 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1218 microversion: 2.1 time: 0.081679 May 26 13:47:15.153374 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 195/394] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:15 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:15.245856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c8c97546-d571-4a63-9d6f-b8096324f1cb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:15.246594 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c8c97546-d571-4a63-9d6f-b8096324f1cb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:15.253433 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8c97546-d571-4a63-9d6f-b8096324f1cb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.253866 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8c97546-d571-4a63-9d6f-b8096324f1cb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.255243 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8c97546-d571-4a63-9d6f-b8096324f1cb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.255243 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c8c97546-d571-4a63-9d6f-b8096324f1cb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.380892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bdfb644d-3619-4386-b482-96d141368484 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:15.381610 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bdfb644d-3619-4386-b482-96d141368484 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:15.387657 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bdfb644d-3619-4386-b482-96d141368484 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.388185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bdfb644d-3619-4386-b482-96d141368484 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.388903 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c8c97546-d571-4a63-9d6f-b8096324f1cb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:15.389140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bdfb644d-3619-4386-b482-96d141368484 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.389644 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bdfb644d-3619-4386-b482-96d141368484 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.397327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c8c97546-d571-4a63-9d6f-b8096324f1cb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.155339 May 26 13:47:15.397905 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 200/395] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:15 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:15.453978 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bdfb644d-3619-4386-b482-96d141368484 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:15.461969 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bdfb644d-3619-4386-b482-96d141368484 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.085448 May 26 13:47:15.462548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 196/396] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:15 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:15.623639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1cd87e15-6e1b-4db5-b443-066848995715 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:15.624570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1cd87e15-6e1b-4db5-b443-066848995715 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:15.631475 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cd87e15-6e1b-4db5-b443-066848995715 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.631900 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cd87e15-6e1b-4db5-b443-066848995715 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.632714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cd87e15-6e1b-4db5-b443-066848995715 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.633209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1cd87e15-6e1b-4db5-b443-066848995715 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.692470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-062c5ee6-dc88-4aa2-8259-a08e0e5629d4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:15.693300 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-062c5ee6-dc88-4aa2-8259-a08e0e5629d4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:15.700459 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-062c5ee6-dc88-4aa2-8259-a08e0e5629d4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.700728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-062c5ee6-dc88-4aa2-8259-a08e0e5629d4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.701535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-062c5ee6-dc88-4aa2-8259-a08e0e5629d4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:15.701974 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-062c5ee6-dc88-4aa2-8259-a08e0e5629d4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:15.703892 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1cd87e15-6e1b-4db5-b443-066848995715 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:15.713177 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1cd87e15-6e1b-4db5-b443-066848995715 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1139 microversion: 2.1 time: 0.093321 May 26 13:47:15.714019 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 201/397] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:15 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:15.854467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-062c5ee6-dc88-4aa2-8259-a08e0e5629d4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:15.862682 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-062c5ee6-dc88-4aa2-8259-a08e0e5629d4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.174751 May 26 13:47:15.863256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 197/398] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:15 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:16.170152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf5e6b48-6727-4873-895b-492e9cc09272 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:16.170764 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf5e6b48-6727-4873-895b-492e9cc09272 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:16.177631 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf5e6b48-6727-4873-895b-492e9cc09272 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.178016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf5e6b48-6727-4873-895b-492e9cc09272 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.178848 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf5e6b48-6727-4873-895b-492e9cc09272 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.179345 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf5e6b48-6727-4873-895b-492e9cc09272 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.239460 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bf5e6b48-6727-4873-895b-492e9cc09272 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:16.241643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:16.248171 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf5e6b48-6727-4873-895b-492e9cc09272 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1218 microversion: 2.1 time: 0.081932 May 26 13:47:16.248787 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 202/399] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:16 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:16.414915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-30bf0ed3-1c7f-4073-8e3c-e5c743205f8a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:16.415547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-30bf0ed3-1c7f-4073-8e3c-e5c743205f8a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:16.422237 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-30bf0ed3-1c7f-4073-8e3c-e5c743205f8a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.422712 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-30bf0ed3-1c7f-4073-8e3c-e5c743205f8a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.423531 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-30bf0ed3-1c7f-4073-8e3c-e5c743205f8a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.424593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-30bf0ed3-1c7f-4073-8e3c-e5c743205f8a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.427363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:16.479354 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b97ff7ff-a983-456e-9f49-38bec75ab02a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:16.480096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b97ff7ff-a983-456e-9f49-38bec75ab02a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:16.482203 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:16.488349 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b97ff7ff-a983-456e-9f49-38bec75ab02a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.488779 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b97ff7ff-a983-456e-9f49-38bec75ab02a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.489905 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b97ff7ff-a983-456e-9f49-38bec75ab02a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.490349 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b97ff7ff-a983-456e-9f49-38bec75ab02a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.567139 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b97ff7ff-a983-456e-9f49-38bec75ab02a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:16.574917 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b97ff7ff-a983-456e-9f49-38bec75ab02a tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.099408 May 26 13:47:16.575497 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 203/400] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:16 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:16.579599 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-30bf0ed3-1c7f-4073-8e3c-e5c743205f8a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:16.587845 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-30bf0ed3-1c7f-4073-8e3c-e5c743205f8a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.176858 May 26 13:47:16.588460 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 198/401] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:16 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:16.730212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-029b3bd9-f150-497a-b93e-63121c0dd0e2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:16.730739 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-029b3bd9-f150-497a-b93e-63121c0dd0e2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:16.737351 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-029b3bd9-f150-497a-b93e-63121c0dd0e2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.737792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-029b3bd9-f150-497a-b93e-63121c0dd0e2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.738550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-029b3bd9-f150-497a-b93e-63121c0dd0e2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.738983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-029b3bd9-f150-497a-b93e-63121c0dd0e2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.800879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-029b3bd9-f150-497a-b93e-63121c0dd0e2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:16.808339 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-029b3bd9-f150-497a-b93e-63121c0dd0e2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1139 microversion: 2.1 time: 0.082036 May 26 13:47:16.808909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 204/402] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:16 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:16.879859 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-aaea6839-9865-46f5-9db3-c89a86133739 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:16.880492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-aaea6839-9865-46f5-9db3-c89a86133739 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:16.886411 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aaea6839-9865-46f5-9db3-c89a86133739 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.886853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aaea6839-9865-46f5-9db3-c89a86133739 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:16.887597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aaea6839-9865-46f5-9db3-c89a86133739 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:16.888025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aaea6839-9865-46f5-9db3-c89a86133739 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.019413 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-aaea6839-9865-46f5-9db3-c89a86133739 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:17.026711 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-aaea6839-9865-46f5-9db3-c89a86133739 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.150953 May 26 13:47:17.027267 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 199/403] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:16 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:17.265894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e2c43cf7-3e46-4000-b3bf-4a3c5ff6809f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:17.266702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e2c43cf7-3e46-4000-b3bf-4a3c5ff6809f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:17.273257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2c43cf7-3e46-4000-b3bf-4a3c5ff6809f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:17.273702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2c43cf7-3e46-4000-b3bf-4a3c5ff6809f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.274501 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2c43cf7-3e46-4000-b3bf-4a3c5ff6809f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:17.274894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2c43cf7-3e46-4000-b3bf-4a3c5ff6809f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.338956 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e2c43cf7-3e46-4000-b3bf-4a3c5ff6809f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:17.346476 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e2c43cf7-3e46-4000-b3bf-4a3c5ff6809f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1218 microversion: 2.1 time: 0.084441 May 26 13:47:17.347043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 205/404] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:17 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:17.592247 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7e9ba2cf-d05c-496d-a993-d512c0cd7eb0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:17.592824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7e9ba2cf-d05c-496d-a993-d512c0cd7eb0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:17.599922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e9ba2cf-d05c-496d-a993-d512c0cd7eb0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:17.600431 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e9ba2cf-d05c-496d-a993-d512c0cd7eb0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.601224 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e9ba2cf-d05c-496d-a993-d512c0cd7eb0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:17.601661 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7e9ba2cf-d05c-496d-a993-d512c0cd7eb0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.605082 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ee60f2e7-e478-463b-9d83-e99920b7abb0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:17.605684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ee60f2e7-e478-463b-9d83-e99920b7abb0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:17.612615 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee60f2e7-e478-463b-9d83-e99920b7abb0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:17.612964 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee60f2e7-e478-463b-9d83-e99920b7abb0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.613737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee60f2e7-e478-463b-9d83-e99920b7abb0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:17.615010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee60f2e7-e478-463b-9d83-e99920b7abb0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.668909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7e9ba2cf-d05c-496d-a993-d512c0cd7eb0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:17.677985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7e9ba2cf-d05c-496d-a993-d512c0cd7eb0 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.089609 May 26 13:47:17.678776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 200/405] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:17 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:17.758969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ee60f2e7-e478-463b-9d83-e99920b7abb0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:17.766801 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ee60f2e7-e478-463b-9d83-e99920b7abb0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.165461 May 26 13:47:17.767436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 206/406] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:17 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:17.825792 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e0b9c838-8887-4c20-bd3a-c9735cde9373 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:17.826390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e0b9c838-8887-4c20-bd3a-c9735cde9373 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:17.833050 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0b9c838-8887-4c20-bd3a-c9735cde9373 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:17.833508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0b9c838-8887-4c20-bd3a-c9735cde9373 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.834280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0b9c838-8887-4c20-bd3a-c9735cde9373 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:17.834714 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0b9c838-8887-4c20-bd3a-c9735cde9373 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:17.896080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e0b9c838-8887-4c20-bd3a-c9735cde9373 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:17.903586 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e0b9c838-8887-4c20-bd3a-c9735cde9373 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1139 microversion: 2.1 time: 0.081890 May 26 13:47:17.904162 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 201/407] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:17 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:18.044288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1ea491b2-9f13-42ac-9257-5a6d3f6ec4c9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:18.044916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1ea491b2-9f13-42ac-9257-5a6d3f6ec4c9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:18.051894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ea491b2-9f13-42ac-9257-5a6d3f6ec4c9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.052516 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ea491b2-9f13-42ac-9257-5a6d3f6ec4c9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.053137 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ea491b2-9f13-42ac-9257-5a6d3f6ec4c9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.053570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1ea491b2-9f13-42ac-9257-5a6d3f6ec4c9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.187445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1ea491b2-9f13-42ac-9257-5a6d3f6ec4c9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:18.195317 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1ea491b2-9f13-42ac-9257-5a6d3f6ec4c9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.154822 May 26 13:47:18.195922 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 207/408] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:18 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:18.363167 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8d2f0390-c034-4492-83c4-038ec6b6b3f9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:18.363779 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8d2f0390-c034-4492-83c4-038ec6b6b3f9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:18.370109 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d2f0390-c034-4492-83c4-038ec6b6b3f9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.370619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d2f0390-c034-4492-83c4-038ec6b6b3f9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.371399 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d2f0390-c034-4492-83c4-038ec6b6b3f9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.371859 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d2f0390-c034-4492-83c4-038ec6b6b3f9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.437002 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8d2f0390-c034-4492-83c4-038ec6b6b3f9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:18.444816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8d2f0390-c034-4492-83c4-038ec6b6b3f9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1218 microversion: 2.1 time: 0.085596 May 26 13:47:18.445387 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 202/409] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:18 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:18.696098 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5eaa0ede-b52b-4c14-aee2-4d0d8f419863 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:18.696939 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5eaa0ede-b52b-4c14-aee2-4d0d8f419863 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:18.703039 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5eaa0ede-b52b-4c14-aee2-4d0d8f419863 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.703489 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5eaa0ede-b52b-4c14-aee2-4d0d8f419863 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.704253 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5eaa0ede-b52b-4c14-aee2-4d0d8f419863 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.705543 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5eaa0ede-b52b-4c14-aee2-4d0d8f419863 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.768362 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5eaa0ede-b52b-4c14-aee2-4d0d8f419863 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:18.776220 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5eaa0ede-b52b-4c14-aee2-4d0d8f419863 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1461 microversion: 2.1 time: 0.084032 May 26 13:47:18.776839 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 208/410] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:18 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:18.783637 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f8d30876-a917-424e-94a4-d23ddf6626e7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:18.784394 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f8d30876-a917-424e-94a4-d23ddf6626e7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:18.790375 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f8d30876-a917-424e-94a4-d23ddf6626e7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.790813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f8d30876-a917-424e-94a4-d23ddf6626e7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.791577 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f8d30876-a917-424e-94a4-d23ddf6626e7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.792010 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f8d30876-a917-424e-94a4-d23ddf6626e7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.920876 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-34a1482e-fd05-427a-a87f-70aa6ce3dca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:18.921484 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-34a1482e-fd05-427a-a87f-70aa6ce3dca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:18.926479 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f8d30876-a917-424e-94a4-d23ddf6626e7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:18.927945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34a1482e-fd05-427a-a87f-70aa6ce3dca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.928495 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34a1482e-fd05-427a-a87f-70aa6ce3dca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.929206 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34a1482e-fd05-427a-a87f-70aa6ce3dca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:18.929639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-34a1482e-fd05-427a-a87f-70aa6ce3dca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:18.934367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f8d30876-a917-424e-94a4-d23ddf6626e7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.155108 May 26 13:47:18.935120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 203/411] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:18 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:18.994678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-34a1482e-fd05-427a-a87f-70aa6ce3dca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:19.002781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-34a1482e-fd05-427a-a87f-70aa6ce3dca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1139 microversion: 2.1 time: 0.085757 May 26 13:47:19.003366 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 209/412] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:18 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1139 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:19.214005 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-94cfdcf4-d9b8-4b21-bf67-8ee0970b024d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:19.214647 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-94cfdcf4-d9b8-4b21-bf67-8ee0970b024d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:19.216587 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:19.220594 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=6 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:19.223080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-94cfdcf4-d9b8-4b21-bf67-8ee0970b024d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:19.223526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-94cfdcf4-d9b8-4b21-bf67-8ee0970b024d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:19.224319 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-94cfdcf4-d9b8-4b21-bf67-8ee0970b024d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:19.224788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-94cfdcf4-d9b8-4b21-bf67-8ee0970b024d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:19.359012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-94cfdcf4-d9b8-4b21-bf67-8ee0970b024d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:19.367258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-94cfdcf4-d9b8-4b21-bf67-8ee0970b024d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.158097 May 26 13:47:19.367842 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 204/413] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:19 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:19.461958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f0da40cf-5158-4ea1-9df9-8d29e23578db tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:19.462562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f0da40cf-5158-4ea1-9df9-8d29e23578db tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:19.468761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0da40cf-5158-4ea1-9df9-8d29e23578db tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:19.469208 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0da40cf-5158-4ea1-9df9-8d29e23578db tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:19.469985 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0da40cf-5158-4ea1-9df9-8d29e23578db tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:19.470986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f0da40cf-5158-4ea1-9df9-8d29e23578db tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:19.534619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f0da40cf-5158-4ea1-9df9-8d29e23578db tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:19.542388 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f0da40cf-5158-4ea1-9df9-8d29e23578db tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1218 microversion: 2.1 time: 0.084214 May 26 13:47:19.542986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 210/414] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:19 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:19.794790 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-eaca0e8e-91f8-47a9-b571-0fd37ff1b040 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:19.796239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-eaca0e8e-91f8-47a9-b571-0fd37ff1b040 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:19.811003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-eaca0e8e-91f8-47a9-b571-0fd37ff1b040 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:19.811856 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-eaca0e8e-91f8-47a9-b571-0fd37ff1b040 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:19.813306 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-eaca0e8e-91f8-47a9-b571-0fd37ff1b040 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:19.817102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-eaca0e8e-91f8-47a9-b571-0fd37ff1b040 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:19.958390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0b7acb86-f2f9-4298-9135-49a9cb6c79ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:19.959621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0b7acb86-f2f9-4298-9135-49a9cb6c79ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:19.966668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b7acb86-f2f9-4298-9135-49a9cb6c79ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:19.967403 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b7acb86-f2f9-4298-9135-49a9cb6c79ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:19.968542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b7acb86-f2f9-4298-9135-49a9cb6c79ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:19.968972 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b7acb86-f2f9-4298-9135-49a9cb6c79ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:19.971248 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-eaca0e8e-91f8-47a9-b571-0fd37ff1b040 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:19.982539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-eaca0e8e-91f8-47a9-b571-0fd37ff1b040 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1299 microversion: 2.1 time: 0.190248 May 26 13:47:19.992532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 205/415] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:19 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1299 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:20.021184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-79a63de2-57db-484e-9eb8-8d315a82b3f1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:20.022800 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-79a63de2-57db-484e-9eb8-8d315a82b3f1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:20.039801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-79a63de2-57db-484e-9eb8-8d315a82b3f1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:20.042963 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-79a63de2-57db-484e-9eb8-8d315a82b3f1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:20.043953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-79a63de2-57db-484e-9eb8-8d315a82b3f1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:20.044512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-79a63de2-57db-484e-9eb8-8d315a82b3f1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:20.185690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0b7acb86-f2f9-4298-9135-49a9cb6c79ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:20.197085 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0b7acb86-f2f9-4298-9135-49a9cb6c79ab tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.243201 May 26 13:47:20.197865 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 211/416] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:19 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:20.380783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-79a63de2-57db-484e-9eb8-8d315a82b3f1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:20.385912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c5208438-66b2-4e48-8159-a3084b0334cb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:20.386853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c5208438-66b2-4e48-8159-a3084b0334cb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:20.390256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-79a63de2-57db-484e-9eb8-8d315a82b3f1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1131 microversion: 2.1 time: 0.374701 May 26 13:47:20.391315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 206/417] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:20 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1131 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:20.395245 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5208438-66b2-4e48-8159-a3084b0334cb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:20.395714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5208438-66b2-4e48-8159-a3084b0334cb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:20.396534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5208438-66b2-4e48-8159-a3084b0334cb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:20.396974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5208438-66b2-4e48-8159-a3084b0334cb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:20.551237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c5208438-66b2-4e48-8159-a3084b0334cb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:20.559314 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c5208438-66b2-4e48-8159-a3084b0334cb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.178340 May 26 13:47:20.559927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 212/418] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:20 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:20.560079 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2e9f1b99-e858-4d0d-bbd1-03c27ccb8c9c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:20.560707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2e9f1b99-e858-4d0d-bbd1-03c27ccb8c9c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:20.567694 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2e9f1b99-e858-4d0d-bbd1-03c27ccb8c9c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:20.568135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2e9f1b99-e858-4d0d-bbd1-03c27ccb8c9c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:20.568971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2e9f1b99-e858-4d0d-bbd1-03c27ccb8c9c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:20.569384 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2e9f1b99-e858-4d0d-bbd1-03c27ccb8c9c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:20.637523 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2e9f1b99-e858-4d0d-bbd1-03c27ccb8c9c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:20.645804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2e9f1b99-e858-4d0d-bbd1-03c27ccb8c9c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1266 microversion: 2.1 time: 0.089602 May 26 13:47:20.646370 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 207/419] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:20 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:21.005367 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:21.005973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:21.012572 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.013022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.013797 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.014236 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.045497 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.045947 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.046394 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lazy-loading 'fault' on Instance uuid 460c9c68-cb94-4868-833a-0c18408bf8a1 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:47:21.088394 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:21.095806 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6071830b-8302-4aa6-975a-ae467f381fc6 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1304 microversion: 2.1 time: 0.095065 May 26 13:47:21.096380 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 213/420] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:20 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:21.215098 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-31620453-58ff-4cb2-9674-e59f989dbe97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:21.215705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-31620453-58ff-4cb2-9674-e59f989dbe97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:21.222155 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-31620453-58ff-4cb2-9674-e59f989dbe97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.222606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-31620453-58ff-4cb2-9674-e59f989dbe97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.223371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-31620453-58ff-4cb2-9674-e59f989dbe97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.223805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-31620453-58ff-4cb2-9674-e59f989dbe97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.351262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-31620453-58ff-4cb2-9674-e59f989dbe97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:21.358756 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-31620453-58ff-4cb2-9674-e59f989dbe97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.147458 May 26 13:47:21.359316 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 208/421] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:21 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:21.409118 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9752ab2c-f5a5-4b22-a5f7-5fbfb6338480 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:21.409715 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9752ab2c-f5a5-4b22-a5f7-5fbfb6338480 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:21.415696 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9752ab2c-f5a5-4b22-a5f7-5fbfb6338480 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.416146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9752ab2c-f5a5-4b22-a5f7-5fbfb6338480 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.416937 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9752ab2c-f5a5-4b22-a5f7-5fbfb6338480 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.417364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9752ab2c-f5a5-4b22-a5f7-5fbfb6338480 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.477970 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9752ab2c-f5a5-4b22-a5f7-5fbfb6338480 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:21.485396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9752ab2c-f5a5-4b22-a5f7-5fbfb6338480 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1187 microversion: 2.1 time: 0.080138 May 26 13:47:21.486502 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 214/422] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:21 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1187 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:21.583001 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b0c10665-299d-4495-8a0a-ef5729bad5a4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:21.583777 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b0c10665-299d-4495-8a0a-ef5729bad5a4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:21.589976 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b0c10665-299d-4495-8a0a-ef5729bad5a4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.590427 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b0c10665-299d-4495-8a0a-ef5729bad5a4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.591196 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b0c10665-299d-4495-8a0a-ef5729bad5a4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.591639 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b0c10665-299d-4495-8a0a-ef5729bad5a4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.663271 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dd4c0f5b-f903-4047-a208-5062a78f6c28 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:21.663882 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dd4c0f5b-f903-4047-a208-5062a78f6c28 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:21.665756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:21.671540 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd4c0f5b-f903-4047-a208-5062a78f6c28 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.671986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd4c0f5b-f903-4047-a208-5062a78f6c28 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.672790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd4c0f5b-f903-4047-a208-5062a78f6c28 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:21.673221 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dd4c0f5b-f903-4047-a208-5062a78f6c28 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:21.721090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b0c10665-299d-4495-8a0a-ef5729bad5a4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:21.728979 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b0c10665-299d-4495-8a0a-ef5729bad5a4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.149714 May 26 13:47:21.729579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 209/423] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:21 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:21.735665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dd4c0f5b-f903-4047-a208-5062a78f6c28 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:21.743426 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dd4c0f5b-f903-4047-a208-5062a78f6c28 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1266 microversion: 2.1 time: 0.083970 May 26 13:47:21.743991 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 215/424] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:21 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:22.114127 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:22.114651 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:22.121345 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.121800 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.122570 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.123006 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.157258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.157742 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.158197 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lazy-loading 'fault' on Instance uuid 460c9c68-cb94-4868-833a-0c18408bf8a1 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:47:22.212084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:22.222168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-48da1825-f01f-494d-bbf9-a06ecfa2802d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1304 microversion: 2.1 time: 0.112764 May 26 13:47:22.222929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 210/425] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:22 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:22.376334 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-83893f6b-3d88-417f-b57e-e59204f62e6a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:22.377677 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-83893f6b-3d88-417f-b57e-e59204f62e6a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:22.379761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=10 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:22.388295 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83893f6b-3d88-417f-b57e-e59204f62e6a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.389084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83893f6b-3d88-417f-b57e-e59204f62e6a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.389877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83893f6b-3d88-417f-b57e-e59204f62e6a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.390669 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-83893f6b-3d88-417f-b57e-e59204f62e6a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.503068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1f1a90ec-f9d7-48a4-aa70-c2d8b2865a65 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:22.503679 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1f1a90ec-f9d7-48a4-aa70-c2d8b2865a65 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:22.509993 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f1a90ec-f9d7-48a4-aa70-c2d8b2865a65 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.510437 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f1a90ec-f9d7-48a4-aa70-c2d8b2865a65 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.511211 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f1a90ec-f9d7-48a4-aa70-c2d8b2865a65 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.511643 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1f1a90ec-f9d7-48a4-aa70-c2d8b2865a65 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.546313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-83893f6b-3d88-417f-b57e-e59204f62e6a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:22.558934 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-83893f6b-3d88-417f-b57e-e59204f62e6a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.186177 May 26 13:47:22.559769 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 216/426] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:22 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:22.580995 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1f1a90ec-f9d7-48a4-aa70-c2d8b2865a65 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:22.589705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1f1a90ec-f9d7-48a4-aa70-c2d8b2865a65 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1187 microversion: 2.1 time: 0.090571 May 26 13:47:22.590285 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 211/427] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:22 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1187 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:22.746003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e381a8ba-6717-466b-80a7-c854aa8c4a4a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:22.746639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e381a8ba-6717-466b-80a7-c854aa8c4a4a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:22.753202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e381a8ba-6717-466b-80a7-c854aa8c4a4a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.753651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e381a8ba-6717-466b-80a7-c854aa8c4a4a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.754412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e381a8ba-6717-466b-80a7-c854aa8c4a4a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.754854 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e381a8ba-6717-466b-80a7-c854aa8c4a4a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.761088 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6e38aa7a-19db-4453-94c1-b08ad6a4f0b8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:22.761707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6e38aa7a-19db-4453-94c1-b08ad6a4f0b8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:22.768389 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6e38aa7a-19db-4453-94c1-b08ad6a4f0b8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.768838 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6e38aa7a-19db-4453-94c1-b08ad6a4f0b8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.769606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6e38aa7a-19db-4453-94c1-b08ad6a4f0b8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:22.770036 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6e38aa7a-19db-4453-94c1-b08ad6a4f0b8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:22.840842 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6e38aa7a-19db-4453-94c1-b08ad6a4f0b8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:22.849981 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6e38aa7a-19db-4453-94c1-b08ad6a4f0b8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1266 microversion: 2.1 time: 0.092652 May 26 13:47:22.859173 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 212/428] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:22 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:22.899514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e381a8ba-6717-466b-80a7-c854aa8c4a4a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:22.907090 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e381a8ba-6717-466b-80a7-c854aa8c4a4a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.164927 May 26 13:47:22.907736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 217/429] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:22 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:23.240814 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:23.241450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:23.247812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.248254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.249062 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.249492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.281454 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.281885 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.282320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lazy-loading 'fault' on Instance uuid 460c9c68-cb94-4868-833a-0c18408bf8a1 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:47:23.325063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:23.332382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-98669a60-9c7f-4eac-ad56-fb4fedaa0939 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1304 microversion: 2.1 time: 0.095400 May 26 13:47:23.332950 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 213/430] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:23 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:23.577729 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-39164c5f-081c-45bd-8536-1dda89d8d298 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:23.578318 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-39164c5f-081c-45bd-8536-1dda89d8d298 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:23.585377 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39164c5f-081c-45bd-8536-1dda89d8d298 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.585824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39164c5f-081c-45bd-8536-1dda89d8d298 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.586627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39164c5f-081c-45bd-8536-1dda89d8d298 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.587061 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39164c5f-081c-45bd-8536-1dda89d8d298 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.607675 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9f38beec-24b3-4ea5-a926-e10caa1729f8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:23.608280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9f38beec-24b3-4ea5-a926-e10caa1729f8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:23.614355 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9f38beec-24b3-4ea5-a926-e10caa1729f8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.614797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9f38beec-24b3-4ea5-a926-e10caa1729f8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.615557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9f38beec-24b3-4ea5-a926-e10caa1729f8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.616007 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9f38beec-24b3-4ea5-a926-e10caa1729f8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.619959 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:23.679100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9f38beec-24b3-4ea5-a926-e10caa1729f8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:23.686585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9f38beec-24b3-4ea5-a926-e10caa1729f8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1187 microversion: 2.1 time: 0.082725 May 26 13:47:23.687156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 214/431] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:23 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:23.725416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-39164c5f-081c-45bd-8536-1dda89d8d298 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:23.733106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-39164c5f-081c-45bd-8536-1dda89d8d298 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.159842 May 26 13:47:23.733683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 218/432] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:23 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:23.866885 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ac867852-965d-4910-9390-6b7718dd9fb0 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:23.867410 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ac867852-965d-4910-9390-6b7718dd9fb0 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:23.878658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ac867852-965d-4910-9390-6b7718dd9fb0 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.879336 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ac867852-965d-4910-9390-6b7718dd9fb0 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.880146 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ac867852-965d-4910-9390-6b7718dd9fb0 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.880622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ac867852-965d-4910-9390-6b7718dd9fb0 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.923790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e778e1bd-d20e-473e-a783-47727cdec549 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:23.924546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e778e1bd-d20e-473e-a783-47727cdec549 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:23.930607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e778e1bd-d20e-473e-a783-47727cdec549 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.931044 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e778e1bd-d20e-473e-a783-47727cdec549 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.931801 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e778e1bd-d20e-473e-a783-47727cdec549 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:23.932227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e778e1bd-d20e-473e-a783-47727cdec549 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:23.934799 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:23.945363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ac867852-965d-4910-9390-6b7718dd9fb0 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:23.953082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ac867852-965d-4910-9390-6b7718dd9fb0 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1266 microversion: 2.1 time: 0.090252 May 26 13:47:23.953656 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 215/433] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:23 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:24.062084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e778e1bd-d20e-473e-a783-47727cdec549 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:24.070393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e778e1bd-d20e-473e-a783-47727cdec549 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.150462 May 26 13:47:24.070951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 219/434] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:23 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:24.351008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:24.351735 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:24.360113 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.361498 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:24.362701 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.363361 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:24.407097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.407760 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:24.408383 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lazy-loading 'fault' on Instance uuid 460c9c68-cb94-4868-833a-0c18408bf8a1 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:47:24.457443 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7edee75b2845e6bbfbc64574691fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c879e95c508f401fbc77e63b1e64dd16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:24.466603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-059e08dc-13eb-4d2e-aa2f-a68da011adc3 tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 200 len: 1304 microversion: 2.1 time: 0.120855 May 26 13:47:24.467178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 216/435] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:24 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:24.703306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a804e82-02db-425f-a669-f4c81100a124 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:24.703975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a804e82-02db-425f-a669-f4c81100a124 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:24.710120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a804e82-02db-425f-a669-f4c81100a124 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.710567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a804e82-02db-425f-a669-f4c81100a124 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:24.711327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a804e82-02db-425f-a669-f4c81100a124 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.711764 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a804e82-02db-425f-a669-f4c81100a124 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:24.750103 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d1bfb0f1-b70c-4c1b-9a3f-16ef91c65849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:24.750714 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d1bfb0f1-b70c-4c1b-9a3f-16ef91c65849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:24.757130 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d1bfb0f1-b70c-4c1b-9a3f-16ef91c65849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.757577 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d1bfb0f1-b70c-4c1b-9a3f-16ef91c65849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:24.758353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d1bfb0f1-b70c-4c1b-9a3f-16ef91c65849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.758796 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d1bfb0f1-b70c-4c1b-9a3f-16ef91c65849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:24.776999 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6a804e82-02db-425f-a669-f4c81100a124 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:24.785028 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a804e82-02db-425f-a669-f4c81100a124 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1187 microversion: 2.1 time: 0.085595 May 26 13:47:24.785597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 220/436] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:24 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:24.947776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d1bfb0f1-b70c-4c1b-9a3f-16ef91c65849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:24.961809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d1bfb0f1-b70c-4c1b-9a3f-16ef91c65849 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.215388 May 26 13:47:24.971196 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-938c6e86-2e9e-4241-8b76-696ea1fc7af9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:24.972210 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-938c6e86-2e9e-4241-8b76-696ea1fc7af9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:24.972512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 217/437] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:24 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:24.979332 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-938c6e86-2e9e-4241-8b76-696ea1fc7af9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.979781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-938c6e86-2e9e-4241-8b76-696ea1fc7af9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:24.980621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-938c6e86-2e9e-4241-8b76-696ea1fc7af9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:24.981059 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-938c6e86-2e9e-4241-8b76-696ea1fc7af9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:25.080444 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-938c6e86-2e9e-4241-8b76-696ea1fc7af9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:25.088553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-938c6e86-2e9e-4241-8b76-696ea1fc7af9 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1274 microversion: 2.1 time: 0.121661 May 26 13:47:25.088836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-095872a6-4765-4a9e-924d-8351b1bc0177 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:25.089138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 221/438] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:24 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:25.089537 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-095872a6-4765-4a9e-924d-8351b1bc0177 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:25.106326 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-095872a6-4765-4a9e-924d-8351b1bc0177 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:25.106866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-095872a6-4765-4a9e-924d-8351b1bc0177 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:25.107706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-095872a6-4765-4a9e-924d-8351b1bc0177 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:25.108202 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-095872a6-4765-4a9e-924d-8351b1bc0177 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:25.442319 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-095872a6-4765-4a9e-924d-8351b1bc0177 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:25.450086 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-095872a6-4765-4a9e-924d-8351b1bc0177 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.365892 May 26 13:47:25.450642 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 218/439] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:25 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:25.483008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:25.483645 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] [instance: 460c9c68-cb94-4868-833a-0c18408bf8a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:25.490041 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:25.490485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:25.491252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:25.491683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:25.506606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] HTTP exception thrown: Instance 460c9c68-cb94-4868-833a-0c18408bf8a1 could not be found. May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Request method failure captured: May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 HTTP/1.1 May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4R5RvC1wOenrKmxZrR-oarY5hCJIsTNgCuc25kbQA502Oj8AhPZbVTTpwAXtVw5QnEYP6vpb-2SiVgX9yM_txwDTwhh8TWdPdmDd7wbtM8JIAQIu-Pu2wGt0MYPJ2i_-pf0YzhrwfLrJQeG26OmWjeT5kHJhyFE1NlYkWEZJiQ51_g May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: c879e95c508f401fbc77e63b1e64dd16 May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesActionsTest-2054095430 May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:47:25.508269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c879e95c508f401fbc77e63b1e64dd16", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c879e95c508f401fbc77e63b1e64dd16"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c879e95c508f401fbc77e63b1e64dd16"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c879e95c508f401fbc77e63b1e64dd16"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesActionsTest-2054095430 May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: c879e95c508f401fbc77e63b1e64dd16 May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesActionsTest-2054095430 May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesActionsTest-2054095430-project May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 6f7edee75b2845e6bbfbc64574691fb0 May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesActionsTest-2054095430-project May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 460c9c68-cb94-4868-833a-0c18408bf8a1 could not be found. May 26 13:47:25.510023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '460c9c68-cb94-4868-833a-0c18408bf8a1'} May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460c9c68-cb94-4868-833a-0c18408bf8a1 could not be found. May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:47:25.510851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460c9c68-cb94-4868-833a-0c18408bf8a1 could not be found. May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460c9c68-cb94-4868-833a-0c18408bf8a1 could not be found. May 26 13:47:25.512057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:47:25.513141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] Returning 404 to user: Instance 460c9c68-cb94-4868-833a-0c18408bf8a1 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:47:25.513141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1024d3f0-609c-4c00-bae7-7ebc208e348d tempest-VolumesActionsTest-2054095430 tempest-VolumesActionsTest-2054095430-project] 10.222.0.16 "GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1" status: 404 len: 111 microversion: 2.1 time: 0.030644 May 26 13:47:25.514174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 222/440] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:25 2022] GET /compute/v2.1/servers/460c9c68-cb94-4868-833a-0c18408bf8a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:47:25.802629 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-58acadec-8c44-48b5-bc4c-b1c4e60701c6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:25.803555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-58acadec-8c44-48b5-bc4c-b1c4e60701c6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:25.805626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:25.813059 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-58acadec-8c44-48b5-bc4c-b1c4e60701c6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:25.815754 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-58acadec-8c44-48b5-bc4c-b1c4e60701c6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:25.816715 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-58acadec-8c44-48b5-bc4c-b1c4e60701c6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:25.817162 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-58acadec-8c44-48b5-bc4c-b1c4e60701c6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:25.888282 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-58acadec-8c44-48b5-bc4c-b1c4e60701c6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:25.897403 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-58acadec-8c44-48b5-bc4c-b1c4e60701c6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1205 microversion: 2.1 time: 0.099665 May 26 13:47:25.898374 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 219/441] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:25 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1205 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:25.980713 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-37dd1849-a668-4d6c-9020-bd5dccf0229d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:25.981337 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-37dd1849-a668-4d6c-9020-bd5dccf0229d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:25.990073 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37dd1849-a668-4d6c-9020-bd5dccf0229d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:25.990825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37dd1849-a668-4d6c-9020-bd5dccf0229d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:25.991737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37dd1849-a668-4d6c-9020-bd5dccf0229d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:25.992572 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37dd1849-a668-4d6c-9020-bd5dccf0229d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:26.105708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-26b423f5-a56a-4c55-b34e-a5e5508249fc tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:26.106321 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-26b423f5-a56a-4c55-b34e-a5e5508249fc tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:26.114517 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-26b423f5-a56a-4c55-b34e-a5e5508249fc tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:26.114961 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-26b423f5-a56a-4c55-b34e-a5e5508249fc tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:26.115755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-26b423f5-a56a-4c55-b34e-a5e5508249fc tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:26.116410 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-26b423f5-a56a-4c55-b34e-a5e5508249fc tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:26.189890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-26b423f5-a56a-4c55-b34e-a5e5508249fc tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:26.198770 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-26b423f5-a56a-4c55-b34e-a5e5508249fc tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1272 microversion: 2.1 time: 0.096771 May 26 13:47:26.208698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 220/442] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:26 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:26.254292 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-37dd1849-a668-4d6c-9020-bd5dccf0229d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:26.263686 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-37dd1849-a668-4d6c-9020-bd5dccf0229d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.287699 May 26 13:47:26.264723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 223/443] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:25 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:26.468465 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e9dbfe72-f33a-47a7-9f2a-c28531047218 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:26.469928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e9dbfe72-f33a-47a7-9f2a-c28531047218 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:26.477428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9dbfe72-f33a-47a7-9f2a-c28531047218 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:26.477974 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9dbfe72-f33a-47a7-9f2a-c28531047218 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:26.478857 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9dbfe72-f33a-47a7-9f2a-c28531047218 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:26.479366 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9dbfe72-f33a-47a7-9f2a-c28531047218 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:26.644381 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e9dbfe72-f33a-47a7-9f2a-c28531047218 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:26.652541 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e9dbfe72-f33a-47a7-9f2a-c28531047218 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.189013 May 26 13:47:26.653451 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 221/444] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:26 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:26.924958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a63d59b8-49bc-49e4-80d6-aedd9f687cf1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:26.925705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a63d59b8-49bc-49e4-80d6-aedd9f687cf1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:26.933101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a63d59b8-49bc-49e4-80d6-aedd9f687cf1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:26.933636 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a63d59b8-49bc-49e4-80d6-aedd9f687cf1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:26.934525 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a63d59b8-49bc-49e4-80d6-aedd9f687cf1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:26.935036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a63d59b8-49bc-49e4-80d6-aedd9f687cf1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:27.102652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a63d59b8-49bc-49e4-80d6-aedd9f687cf1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:27.110300 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a63d59b8-49bc-49e4-80d6-aedd9f687cf1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1273 microversion: 2.1 time: 0.191763 May 26 13:47:27.111483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 224/445] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:26 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:27.216794 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f856351a-e6f8-40e1-a201-619715405a34 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:27.217872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f856351a-e6f8-40e1-a201-619715405a34 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:27.224935 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f856351a-e6f8-40e1-a201-619715405a34 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:27.225379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f856351a-e6f8-40e1-a201-619715405a34 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:27.226149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f856351a-e6f8-40e1-a201-619715405a34 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:27.226577 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f856351a-e6f8-40e1-a201-619715405a34 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:27.281831 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d1e04af3-cb81-4fdd-9540-d2ee752e1853 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:27.282432 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d1e04af3-cb81-4fdd-9540-d2ee752e1853 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:27.289382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1e04af3-cb81-4fdd-9540-d2ee752e1853 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:27.289819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1e04af3-cb81-4fdd-9540-d2ee752e1853 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:27.290580 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1e04af3-cb81-4fdd-9540-d2ee752e1853 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:27.291006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1e04af3-cb81-4fdd-9540-d2ee752e1853 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:27.370327 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f856351a-e6f8-40e1-a201-619715405a34 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:27.379927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f856351a-e6f8-40e1-a201-619715405a34 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.166867 May 26 13:47:27.380984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 222/446] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:27 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:27.439993 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d1e04af3-cb81-4fdd-9540-d2ee752e1853 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:27.447735 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d1e04af3-cb81-4fdd-9540-d2ee752e1853 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.170041 May 26 13:47:27.448292 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 225/447] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:27 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:27.670421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4a8edcda-218a-4ff3-9bc0-1c2e5b2985ee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:27.670967 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4a8edcda-218a-4ff3-9bc0-1c2e5b2985ee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:27.678693 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4a8edcda-218a-4ff3-9bc0-1c2e5b2985ee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:27.679143 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4a8edcda-218a-4ff3-9bc0-1c2e5b2985ee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:27.679904 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4a8edcda-218a-4ff3-9bc0-1c2e5b2985ee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:27.680364 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4a8edcda-218a-4ff3-9bc0-1c2e5b2985ee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:27.814826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4a8edcda-218a-4ff3-9bc0-1c2e5b2985ee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:27.822924 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4a8edcda-218a-4ff3-9bc0-1c2e5b2985ee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.156403 May 26 13:47:27.823492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 223/448] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:27 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:28.128350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fd6c9f4d-9278-4d4d-89b0-a663f3743617 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:28.128956 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fd6c9f4d-9278-4d4d-89b0-a663f3743617 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:28.135004 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd6c9f4d-9278-4d4d-89b0-a663f3743617 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:28.135449 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd6c9f4d-9278-4d4d-89b0-a663f3743617 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:28.136207 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd6c9f4d-9278-4d4d-89b0-a663f3743617 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:28.136681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fd6c9f4d-9278-4d4d-89b0-a663f3743617 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:28.265695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fd6c9f4d-9278-4d4d-89b0-a663f3743617 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:28.273216 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fd6c9f4d-9278-4d4d-89b0-a663f3743617 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1273 microversion: 2.1 time: 0.149411 May 26 13:47:28.273781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 226/449] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:28 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:28.399446 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-14722995-098c-4a34-98f9-86476196c87f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:28.400097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-14722995-098c-4a34-98f9-86476196c87f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:28.406126 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14722995-098c-4a34-98f9-86476196c87f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:28.406579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14722995-098c-4a34-98f9-86476196c87f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:28.407853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14722995-098c-4a34-98f9-86476196c87f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:28.408359 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14722995-098c-4a34-98f9-86476196c87f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:28.465564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-45bdc4d6-a7bd-46af-aeec-9f338d9a423d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:28.466108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-45bdc4d6-a7bd-46af-aeec-9f338d9a423d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:28.472821 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45bdc4d6-a7bd-46af-aeec-9f338d9a423d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:28.473270 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45bdc4d6-a7bd-46af-aeec-9f338d9a423d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:28.474043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45bdc4d6-a7bd-46af-aeec-9f338d9a423d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:28.474479 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-45bdc4d6-a7bd-46af-aeec-9f338d9a423d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:28.551216 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-14722995-098c-4a34-98f9-86476196c87f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:28.558962 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-14722995-098c-4a34-98f9-86476196c87f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.163457 May 26 13:47:28.559544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 224/450] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:28 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:28.606313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-45bdc4d6-a7bd-46af-aeec-9f338d9a423d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:28.614683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-45bdc4d6-a7bd-46af-aeec-9f338d9a423d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.153232 May 26 13:47:28.615248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 227/451] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:28 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:28.840604 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-345aa85f-09cd-41a8-ae76-7c536e630835 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:28.841147 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-345aa85f-09cd-41a8-ae76-7c536e630835 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:28.848460 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-345aa85f-09cd-41a8-ae76-7c536e630835 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:28.848912 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-345aa85f-09cd-41a8-ae76-7c536e630835 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:28.849683 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-345aa85f-09cd-41a8-ae76-7c536e630835 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:28.850121 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-345aa85f-09cd-41a8-ae76-7c536e630835 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:28.981673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-345aa85f-09cd-41a8-ae76-7c536e630835 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:28.989312 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-345aa85f-09cd-41a8-ae76-7c536e630835 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.152661 May 26 13:47:28.990070 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 225/452] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:28 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:29.289826 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6b90ddd9-bf40-435a-923f-a7054a54f75e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:29.290452 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6b90ddd9-bf40-435a-923f-a7054a54f75e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:29.296523 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b90ddd9-bf40-435a-923f-a7054a54f75e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:29.296970 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b90ddd9-bf40-435a-923f-a7054a54f75e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:29.298608 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b90ddd9-bf40-435a-923f-a7054a54f75e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:29.299054 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b90ddd9-bf40-435a-923f-a7054a54f75e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:29.433461 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6b90ddd9-bf40-435a-923f-a7054a54f75e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:29.441518 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6b90ddd9-bf40-435a-923f-a7054a54f75e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1273 microversion: 2.1 time: 0.155477 May 26 13:47:29.442161 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 228/453] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:29 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:29.575816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9669223e-68fb-45e1-bafa-c353a407270c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:29.576362 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9669223e-68fb-45e1-bafa-c353a407270c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:29.582689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9669223e-68fb-45e1-bafa-c353a407270c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:29.583140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9669223e-68fb-45e1-bafa-c353a407270c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:29.583906 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9669223e-68fb-45e1-bafa-c353a407270c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:29.584373 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9669223e-68fb-45e1-bafa-c353a407270c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:29.631467 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9a3ef914-69f2-4f1e-8ff6-bd9e14dcec2a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:29.632280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9a3ef914-69f2-4f1e-8ff6-bd9e14dcec2a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:29.638660 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a3ef914-69f2-4f1e-8ff6-bd9e14dcec2a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:29.639102 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a3ef914-69f2-4f1e-8ff6-bd9e14dcec2a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:29.639865 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a3ef914-69f2-4f1e-8ff6-bd9e14dcec2a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:29.640295 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9a3ef914-69f2-4f1e-8ff6-bd9e14dcec2a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:29.716102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9669223e-68fb-45e1-bafa-c353a407270c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:29.723758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9669223e-68fb-45e1-bafa-c353a407270c tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.152174 May 26 13:47:29.724422 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 226/454] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:29 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:29.770744 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9a3ef914-69f2-4f1e-8ff6-bd9e14dcec2a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:29.778257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9a3ef914-69f2-4f1e-8ff6-bd9e14dcec2a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.150619 May 26 13:47:29.778821 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 229/455] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:29 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:30.006832 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b1e6d286-2420-4c32-8800-4495eed8949a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:30.007543 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b1e6d286-2420-4c32-8800-4495eed8949a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:30.014162 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1e6d286-2420-4c32-8800-4495eed8949a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:30.014607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1e6d286-2420-4c32-8800-4495eed8949a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:30.015360 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1e6d286-2420-4c32-8800-4495eed8949a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:30.015790 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1e6d286-2420-4c32-8800-4495eed8949a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:30.149891 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b1e6d286-2420-4c32-8800-4495eed8949a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:30.157203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b1e6d286-2420-4c32-8800-4495eed8949a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.154562 May 26 13:47:30.158384 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 227/456] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:30 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:30.458709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4612371c-25f3-4416-93ae-68b53d3ed17e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:30.459318 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4612371c-25f3-4416-93ae-68b53d3ed17e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:30.465408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4612371c-25f3-4416-93ae-68b53d3ed17e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:30.465853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4612371c-25f3-4416-93ae-68b53d3ed17e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:30.466615 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4612371c-25f3-4416-93ae-68b53d3ed17e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:30.467053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4612371c-25f3-4416-93ae-68b53d3ed17e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:30.602353 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4612371c-25f3-4416-93ae-68b53d3ed17e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:30.609890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4612371c-25f3-4416-93ae-68b53d3ed17e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1273 microversion: 2.1 time: 0.155639 May 26 13:47:30.610471 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 230/457] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:30 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:30.740574 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-493b013e-7495-454e-a121-d1a29520b506 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:30.741150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-493b013e-7495-454e-a121-d1a29520b506 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:30.747155 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-493b013e-7495-454e-a121-d1a29520b506 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:30.747605 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-493b013e-7495-454e-a121-d1a29520b506 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:30.748400 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-493b013e-7495-454e-a121-d1a29520b506 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:30.748869 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-493b013e-7495-454e-a121-d1a29520b506 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:30.795011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-00066622-bf6e-4f3f-b52d-6cb5675ecea3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:30.795631 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-00066622-bf6e-4f3f-b52d-6cb5675ecea3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:30.801918 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00066622-bf6e-4f3f-b52d-6cb5675ecea3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:30.802370 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00066622-bf6e-4f3f-b52d-6cb5675ecea3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:30.803146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00066622-bf6e-4f3f-b52d-6cb5675ecea3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:30.803589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-00066622-bf6e-4f3f-b52d-6cb5675ecea3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:30.885492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-493b013e-7495-454e-a121-d1a29520b506 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:30.893980 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-493b013e-7495-454e-a121-d1a29520b506 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.157219 May 26 13:47:30.894558 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 228/458] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:30 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:30.935604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-00066622-bf6e-4f3f-b52d-6cb5675ecea3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:30.943655 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-00066622-bf6e-4f3f-b52d-6cb5675ecea3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.152664 May 26 13:47:30.944218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 231/459] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:30 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:31.174725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-363e46b3-f146-4c8d-b164-b92e4ca8c56b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:31.175263 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-363e46b3-f146-4c8d-b164-b92e4ca8c56b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:31.181761 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-363e46b3-f146-4c8d-b164-b92e4ca8c56b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:31.182229 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-363e46b3-f146-4c8d-b164-b92e4ca8c56b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:31.182975 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-363e46b3-f146-4c8d-b164-b92e4ca8c56b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:31.183413 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-363e46b3-f146-4c8d-b164-b92e4ca8c56b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:31.312593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-363e46b3-f146-4c8d-b164-b92e4ca8c56b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:31.321135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-363e46b3-f146-4c8d-b164-b92e4ca8c56b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.150809 May 26 13:47:31.322003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 229/460] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:31 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:31.626997 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c5287f59-aebf-4cda-ac20-8861168baf95 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:31.627627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c5287f59-aebf-4cda-ac20-8861168baf95 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:31.634522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5287f59-aebf-4cda-ac20-8861168baf95 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:31.635047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5287f59-aebf-4cda-ac20-8861168baf95 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:31.635814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5287f59-aebf-4cda-ac20-8861168baf95 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:31.636253 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c5287f59-aebf-4cda-ac20-8861168baf95 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:31.800071 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c5287f59-aebf-4cda-ac20-8861168baf95 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:31.807977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c5287f59-aebf-4cda-ac20-8861168baf95 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1273 microversion: 2.1 time: 0.184788 May 26 13:47:31.808682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 232/461] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:31 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:31.911220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-689ea15b-04f1-4b0c-b816-1854df1f7ce7 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:31.911830 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-689ea15b-04f1-4b0c-b816-1854df1f7ce7 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:31.918122 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-689ea15b-04f1-4b0c-b816-1854df1f7ce7 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:31.918583 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-689ea15b-04f1-4b0c-b816-1854df1f7ce7 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:31.919353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-689ea15b-04f1-4b0c-b816-1854df1f7ce7 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:31.919789 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-689ea15b-04f1-4b0c-b816-1854df1f7ce7 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:31.935698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:31.962390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2dfa5089-f0dd-469e-a15c-fce0b4484feb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:31.962994 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2dfa5089-f0dd-469e-a15c-fce0b4484feb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:31.969312 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dfa5089-f0dd-469e-a15c-fce0b4484feb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:31.970415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dfa5089-f0dd-469e-a15c-fce0b4484feb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:31.971510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dfa5089-f0dd-469e-a15c-fce0b4484feb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:31.971954 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2dfa5089-f0dd-469e-a15c-fce0b4484feb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:32.069555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-689ea15b-04f1-4b0c-b816-1854df1f7ce7 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:32.086210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-689ea15b-04f1-4b0c-b816-1854df1f7ce7 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.179271 May 26 13:47:32.086841 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 230/462] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:31 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:32.131494 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2dfa5089-f0dd-469e-a15c-fce0b4484feb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:32.144150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2dfa5089-f0dd-469e-a15c-fce0b4484feb tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.186100 May 26 13:47:32.145051 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 233/463] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:31 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:32.340252 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2381b0e3-bda8-4fbc-b5bf-09d4a299ef14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:32.347617 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2381b0e3-bda8-4fbc-b5bf-09d4a299ef14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:32.371121 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2381b0e3-bda8-4fbc-b5bf-09d4a299ef14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:32.373208 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2381b0e3-bda8-4fbc-b5bf-09d4a299ef14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:32.378655 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2381b0e3-bda8-4fbc-b5bf-09d4a299ef14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:32.382186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2381b0e3-bda8-4fbc-b5bf-09d4a299ef14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:32.567261 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2381b0e3-bda8-4fbc-b5bf-09d4a299ef14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:32.580002 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2381b0e3-bda8-4fbc-b5bf-09d4a299ef14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.242786 May 26 13:47:32.581913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 231/464] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:32 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:32.826291 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d167ae4-f7d0-4977-881a-4bcc81f69a48 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:32.827716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7d167ae4-f7d0-4977-881a-4bcc81f69a48 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:32.836215 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d167ae4-f7d0-4977-881a-4bcc81f69a48 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:32.837123 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d167ae4-f7d0-4977-881a-4bcc81f69a48 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:32.838381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d167ae4-f7d0-4977-881a-4bcc81f69a48 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:32.838819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d167ae4-f7d0-4977-881a-4bcc81f69a48 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:33.108394 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-906143ad-2ef5-4941-9b66-7571f98e3f3d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:33.109306 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-906143ad-2ef5-4941-9b66-7571f98e3f3d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:33.119926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-906143ad-2ef5-4941-9b66-7571f98e3f3d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:33.120741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-906143ad-2ef5-4941-9b66-7571f98e3f3d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:33.122227 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-906143ad-2ef5-4941-9b66-7571f98e3f3d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:33.122903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-906143ad-2ef5-4941-9b66-7571f98e3f3d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:33.356448 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-906143ad-2ef5-4941-9b66-7571f98e3f3d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:33.372991 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-906143ad-2ef5-4941-9b66-7571f98e3f3d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.273733 May 26 13:47:33.376909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 232/465] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:33 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:33.392163 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-aec5b98d-f00a-4c9a-b2f7-fc8f158e0b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:33.393265 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-aec5b98d-f00a-4c9a-b2f7-fc8f158e0b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:33.410600 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aec5b98d-f00a-4c9a-b2f7-fc8f158e0b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:33.411938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aec5b98d-f00a-4c9a-b2f7-fc8f158e0b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:33.413141 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aec5b98d-f00a-4c9a-b2f7-fc8f158e0b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:33.413855 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aec5b98d-f00a-4c9a-b2f7-fc8f158e0b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:33.578769 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7d167ae4-f7d0-4977-881a-4bcc81f69a48 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:33.600334 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d167ae4-f7d0-4977-881a-4bcc81f69a48 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.778901 May 26 13:47:33.609825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 234/466] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:32 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:33.609825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b337dc7d-c728-4b03-a52c-295e8570bc47 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:33.609825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b337dc7d-c728-4b03-a52c-295e8570bc47 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:33.618793 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-aec5b98d-f00a-4c9a-b2f7-fc8f158e0b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:33.624994 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b337dc7d-c728-4b03-a52c-295e8570bc47 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:33.625448 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b337dc7d-c728-4b03-a52c-295e8570bc47 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:33.626809 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b337dc7d-c728-4b03-a52c-295e8570bc47 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:33.627252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b337dc7d-c728-4b03-a52c-295e8570bc47 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:33.648387 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-aec5b98d-f00a-4c9a-b2f7-fc8f158e0b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.269756 May 26 13:47:33.650414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 233/467] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:33 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:33.978274 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b337dc7d-c728-4b03-a52c-295e8570bc47 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:33.991879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b337dc7d-c728-4b03-a52c-295e8570bc47 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.389730 May 26 13:47:33.996543 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 235/468] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:33 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:34.395390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6a20ee2f-fadc-46e1-81e2-f4e4f0901af8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:34.396967 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6a20ee2f-fadc-46e1-81e2-f4e4f0901af8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:34.403976 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6a20ee2f-fadc-46e1-81e2-f4e4f0901af8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:34.404811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6a20ee2f-fadc-46e1-81e2-f4e4f0901af8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:34.405821 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6a20ee2f-fadc-46e1-81e2-f4e4f0901af8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:34.406472 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6a20ee2f-fadc-46e1-81e2-f4e4f0901af8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:34.603579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6a20ee2f-fadc-46e1-81e2-f4e4f0901af8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:34.616820 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6a20ee2f-fadc-46e1-81e2-f4e4f0901af8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.225706 May 26 13:47:34.617683 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 234/469] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:34 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:34.618453 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-144ae1c7-b85e-41f8-aaf1-e01a138c0dc5 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:34.619595 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-144ae1c7-b85e-41f8-aaf1-e01a138c0dc5 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:34.629147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-144ae1c7-b85e-41f8-aaf1-e01a138c0dc5 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:34.629996 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-144ae1c7-b85e-41f8-aaf1-e01a138c0dc5 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:34.631071 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-144ae1c7-b85e-41f8-aaf1-e01a138c0dc5 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:34.632175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-144ae1c7-b85e-41f8-aaf1-e01a138c0dc5 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:34.660260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:34.667657 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c7dae78c-39db-4967-a3de-1130075158ef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:34.669172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c7dae78c-39db-4967-a3de-1130075158ef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:34.678172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c7dae78c-39db-4967-a3de-1130075158ef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:34.678730 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c7dae78c-39db-4967-a3de-1130075158ef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:34.680055 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c7dae78c-39db-4967-a3de-1130075158ef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:34.680568 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c7dae78c-39db-4967-a3de-1130075158ef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:34.965062 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c7dae78c-39db-4967-a3de-1130075158ef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:34.974402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c7dae78c-39db-4967-a3de-1130075158ef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.311187 May 26 13:47:34.975021 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 235/470] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:34 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:34.980055 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-d5a5f825-ed86-4ab0-af80-bc3d916447b1 req-a8bdabfc-2327-46dd-89c1-3e8e226b25d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb5af8d-022d-4708-aca9-49d3db482dcd", "tag": "04d681e3-ceab-4cf6-876e-aec8b3942d85"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:34.994027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-d5a5f825-ed86-4ab0-af80-bc3d916447b1 req-a8bdabfc-2327-46dd-89c1-3e8e226b25d1 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:34.994646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-d5a5f825-ed86-4ab0-af80-bc3d916447b1 req-a8bdabfc-2327-46dd-89c1-3e8e226b25d1 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:35.008550 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-d5a5f825-ed86-4ab0-af80-bc3d916447b1 req-a8bdabfc-2327-46dd-89c1-3e8e226b25d1 service nova] Creating event network-changed:04d681e3-ceab-4cf6-876e-aec8b3942d85 for instance 2fb5af8d-022d-4708-aca9-49d3db482dcd on hv-cinder-81966 May 26 13:47:35.014186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-d5a5f825-ed86-4ab0-af80-bc3d916447b1 req-a8bdabfc-2327-46dd-89c1-3e8e226b25d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037620 May 26 13:47:35.015041 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 236/471] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:47:35.021320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3bf3295e-03c1-4eed-9a72-a49c01dc7692 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:35.022246 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3bf3295e-03c1-4eed-9a72-a49c01dc7692 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:35.039817 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3bf3295e-03c1-4eed-9a72-a49c01dc7692 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:35.041545 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3bf3295e-03c1-4eed-9a72-a49c01dc7692 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:35.042531 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3bf3295e-03c1-4eed-9a72-a49c01dc7692 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:35.043144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3bf3295e-03c1-4eed-9a72-a49c01dc7692 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:35.237138 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3bf3295e-03c1-4eed-9a72-a49c01dc7692 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:35.247284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3bf3295e-03c1-4eed-9a72-a49c01dc7692 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.229789 May 26 13:47:35.248524 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 237/472] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:35 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:35.378912 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-144ae1c7-b85e-41f8-aaf1-e01a138c0dc5 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:35.394140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-144ae1c7-b85e-41f8-aaf1-e01a138c0dc5 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.780471 May 26 13:47:35.403122 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 236/473] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:34 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:35.637432 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ea144e7d-9532-46c8-b31c-67c5cb0c3a6d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:35.638991 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ea144e7d-9532-46c8-b31c-67c5cb0c3a6d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:35.660258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ea144e7d-9532-46c8-b31c-67c5cb0c3a6d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:35.661263 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ea144e7d-9532-46c8-b31c-67c5cb0c3a6d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:35.668609 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ea144e7d-9532-46c8-b31c-67c5cb0c3a6d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:35.669843 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ea144e7d-9532-46c8-b31c-67c5cb0c3a6d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:35.735870 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-d0a6fcfb-66dc-4bcc-9f4c-59ae1b6cd53e req-6699f19e-0a6f-46c3-b216-f40a11119966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad193e-1516-41cd-8603-74830f1c6fc7", "name": "network-vif-plugged", "status": "completed", "tag": "e0662874-78ce-4387-a824-8ab106baa767"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:35.770791 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-d0a6fcfb-66dc-4bcc-9f4c-59ae1b6cd53e req-6699f19e-0a6f-46c3-b216-f40a11119966 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:35.777609 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-d0a6fcfb-66dc-4bcc-9f4c-59ae1b6cd53e req-6699f19e-0a6f-46c3-b216-f40a11119966 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:35.809560 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-d0a6fcfb-66dc-4bcc-9f4c-59ae1b6cd53e req-6699f19e-0a6f-46c3-b216-f40a11119966 service nova] Creating event network-vif-plugged:e0662874-78ce-4387-a824-8ab106baa767 for instance 39ad193e-1516-41cd-8603-74830f1c6fc7 on hv-cinder-81966 May 26 13:47:35.831117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-d0a6fcfb-66dc-4bcc-9f4c-59ae1b6cd53e req-6699f19e-0a6f-46c3-b216-f40a11119966 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100597 May 26 13:47:35.838527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 237/474] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:47:35.985474 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ea144e7d-9532-46c8-b31c-67c5cb0c3a6d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:35.993262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bac21691-6369-4925-8135-9fc49b109b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:35.994584 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bac21691-6369-4925-8135-9fc49b109b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:36.000215 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ea144e7d-9532-46c8-b31c-67c5cb0c3a6d tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.366028 May 26 13:47:36.002592 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 238/475] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:35 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:36.010460 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac21691-6369-4925-8135-9fc49b109b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:36.010919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac21691-6369-4925-8135-9fc49b109b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:36.011728 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac21691-6369-4925-8135-9fc49b109b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:36.012167 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac21691-6369-4925-8135-9fc49b109b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:36.258062 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bac21691-6369-4925-8135-9fc49b109b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:36.264797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3344eb58-bf1d-4594-bbb5-096578cb13fe tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:36.265501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3344eb58-bf1d-4594-bbb5-096578cb13fe tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:36.270956 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bac21691-6369-4925-8135-9fc49b109b56 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.283252 May 26 13:47:36.280854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3344eb58-bf1d-4594-bbb5-096578cb13fe tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:36.280854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3344eb58-bf1d-4594-bbb5-096578cb13fe tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:36.280854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3344eb58-bf1d-4594-bbb5-096578cb13fe tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:36.280854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3344eb58-bf1d-4594-bbb5-096578cb13fe tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:36.281996 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 238/476] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:35 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:36.411774 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f3a2e7da-7c80-4436-8918-f232ef8c30b6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:36.412507 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f3a2e7da-7c80-4436-8918-f232ef8c30b6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:36.419297 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3a2e7da-7c80-4436-8918-f232ef8c30b6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:36.420103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3a2e7da-7c80-4436-8918-f232ef8c30b6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:36.420581 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3a2e7da-7c80-4436-8918-f232ef8c30b6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:36.424702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f3a2e7da-7c80-4436-8918-f232ef8c30b6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:36.439161 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3344eb58-bf1d-4594-bbb5-096578cb13fe tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:36.447833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3344eb58-bf1d-4594-bbb5-096578cb13fe tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.186782 May 26 13:47:36.458915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 239/477] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:36 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:36.580407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f3a2e7da-7c80-4436-8918-f232ef8c30b6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:36.589853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f3a2e7da-7c80-4436-8918-f232ef8c30b6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.182961 May 26 13:47:36.590541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 239/478] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:36 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:37.019292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6a7d4824-cead-4edf-916e-c4923677f296 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:37.020156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6a7d4824-cead-4edf-916e-c4923677f296 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:37.033848 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6a7d4824-cead-4edf-916e-c4923677f296 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.034522 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6a7d4824-cead-4edf-916e-c4923677f296 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.035885 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6a7d4824-cead-4edf-916e-c4923677f296 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.036343 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6a7d4824-cead-4edf-916e-c4923677f296 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.077849 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-2883ca05-4920-4d80-a9ac-d21fd299140d req-8e651588-e4b5-43c1-9539-b91ce2c287ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d71f53-7765-4d4a-88db-e17c8171cc2e", "tag": "dafda896-9068-4de0-b958-2ee4214d91ff"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:37.089842 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-2883ca05-4920-4d80-a9ac-d21fd299140d req-8e651588-e4b5-43c1-9539-b91ce2c287ec service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.090291 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-2883ca05-4920-4d80-a9ac-d21fd299140d req-8e651588-e4b5-43c1-9539-b91ce2c287ec service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.107114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-2883ca05-4920-4d80-a9ac-d21fd299140d req-8e651588-e4b5-43c1-9539-b91ce2c287ec service nova] Creating event network-changed:dafda896-9068-4de0-b958-2ee4214d91ff for instance d5d71f53-7765-4d4a-88db-e17c8171cc2e on hv-cinder-81966 May 26 13:47:37.116785 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-2883ca05-4920-4d80-a9ac-d21fd299140d req-8e651588-e4b5-43c1-9539-b91ce2c287ec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042336 May 26 13:47:37.121057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 240/479] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:47:37.198817 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6a7d4824-cead-4edf-916e-c4923677f296 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:37.209692 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6a7d4824-cead-4edf-916e-c4923677f296 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.194632 May 26 13:47:37.219890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 240/480] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:37 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:37.289849 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d1baf350-96ac-4f83-9d75-c5bc70bf8ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:37.290964 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d1baf350-96ac-4f83-9d75-c5bc70bf8ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:37.298705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1baf350-96ac-4f83-9d75-c5bc70bf8ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.299357 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1baf350-96ac-4f83-9d75-c5bc70bf8ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.300223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1baf350-96ac-4f83-9d75-c5bc70bf8ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.300759 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d1baf350-96ac-4f83-9d75-c5bc70bf8ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.454308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d1baf350-96ac-4f83-9d75-c5bc70bf8ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:37.464952 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d1baf350-96ac-4f83-9d75-c5bc70bf8ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.179429 May 26 13:47:37.465843 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 241/481] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:37 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:37.469289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3d8b5ae3-5dae-4df1-8db7-42614079da46 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:37.470979 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3d8b5ae3-5dae-4df1-8db7-42614079da46 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:37.482398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3d8b5ae3-5dae-4df1-8db7-42614079da46 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.482915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3d8b5ae3-5dae-4df1-8db7-42614079da46 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.483810 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3d8b5ae3-5dae-4df1-8db7-42614079da46 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.484428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3d8b5ae3-5dae-4df1-8db7-42614079da46 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.609857 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d74977f-4144-4f07-be83-77f245fab143 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:37.611482 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d74977f-4144-4f07-be83-77f245fab143 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:37.619768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d74977f-4144-4f07-be83-77f245fab143 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.620557 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d74977f-4144-4f07-be83-77f245fab143 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.621586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d74977f-4144-4f07-be83-77f245fab143 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:37.622335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d74977f-4144-4f07-be83-77f245fab143 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:37.645039 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3d8b5ae3-5dae-4df1-8db7-42614079da46 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:37.652673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3d8b5ae3-5dae-4df1-8db7-42614079da46 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.190145 May 26 13:47:37.668478 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 241/482] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:37 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:37.786512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9d74977f-4144-4f07-be83-77f245fab143 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:37.794915 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d74977f-4144-4f07-be83-77f245fab143 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.188879 May 26 13:47:37.795761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 242/483] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:37 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:38.227271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2644de25-d9dd-4f61-bd93-aa8cb33ee26b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:38.228595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2644de25-d9dd-4f61-bd93-aa8cb33ee26b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:38.236148 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2644de25-d9dd-4f61-bd93-aa8cb33ee26b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:38.236834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2644de25-d9dd-4f61-bd93-aa8cb33ee26b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:38.237865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2644de25-d9dd-4f61-bd93-aa8cb33ee26b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:38.238377 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2644de25-d9dd-4f61-bd93-aa8cb33ee26b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:38.386367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2644de25-d9dd-4f61-bd93-aa8cb33ee26b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:38.396219 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2644de25-d9dd-4f61-bd93-aa8cb33ee26b tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.172980 May 26 13:47:38.396844 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 242/484] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:38 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:38.483299 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-707ab140-0d81-4879-8353-ce245c1fe775 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:38.484134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-707ab140-0d81-4879-8353-ce245c1fe775 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:38.491010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-707ab140-0d81-4879-8353-ce245c1fe775 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:38.491451 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-707ab140-0d81-4879-8353-ce245c1fe775 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:38.492206 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-707ab140-0d81-4879-8353-ce245c1fe775 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:38.492685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-707ab140-0d81-4879-8353-ce245c1fe775 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:38.643694 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-707ab140-0d81-4879-8353-ce245c1fe775 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:38.651584 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-707ab140-0d81-4879-8353-ce245c1fe775 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.172409 May 26 13:47:38.652174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 243/485] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:38 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:38.670828 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8ed95816-fc85-473f-bb64-141d8bf514a9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:38.671452 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8ed95816-fc85-473f-bb64-141d8bf514a9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:38.678238 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8ed95816-fc85-473f-bb64-141d8bf514a9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:38.678690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8ed95816-fc85-473f-bb64-141d8bf514a9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:38.679716 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8ed95816-fc85-473f-bb64-141d8bf514a9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:38.680157 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8ed95816-fc85-473f-bb64-141d8bf514a9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:38.888736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5aefb721-addb-4792-97cf-60874dd75443 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:38.888736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5aefb721-addb-4792-97cf-60874dd75443 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:38.888736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5aefb721-addb-4792-97cf-60874dd75443 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:38.888736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5aefb721-addb-4792-97cf-60874dd75443 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:38.889505 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5aefb721-addb-4792-97cf-60874dd75443 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:38.889505 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5aefb721-addb-4792-97cf-60874dd75443 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:38.889659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8ed95816-fc85-473f-bb64-141d8bf514a9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:38.889659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8ed95816-fc85-473f-bb64-141d8bf514a9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.211386 May 26 13:47:38.889659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 243/486] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:38 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:39.055653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5aefb721-addb-4792-97cf-60874dd75443 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:39.072436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5aefb721-addb-4792-97cf-60874dd75443 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.259760 May 26 13:47:39.072436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 244/487] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:38 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:39.413704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bd6ec1ac-873c-415e-90d8-f83248d532be tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:39.414310 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bd6ec1ac-873c-415e-90d8-f83248d532be tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:39.421536 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bd6ec1ac-873c-415e-90d8-f83248d532be tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:39.422047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bd6ec1ac-873c-415e-90d8-f83248d532be tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:39.423497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bd6ec1ac-873c-415e-90d8-f83248d532be tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:39.423984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bd6ec1ac-873c-415e-90d8-f83248d532be tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:39.582840 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bd6ec1ac-873c-415e-90d8-f83248d532be tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:39.591624 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bd6ec1ac-873c-415e-90d8-f83248d532be tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.181929 May 26 13:47:39.601889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 244/488] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:39 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:39.669918 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8b4787b9-1316-4031-95b6-106e5daca330 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:39.670628 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8b4787b9-1316-4031-95b6-106e5daca330 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:39.677252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b4787b9-1316-4031-95b6-106e5daca330 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:39.677778 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b4787b9-1316-4031-95b6-106e5daca330 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:39.678639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b4787b9-1316-4031-95b6-106e5daca330 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:39.679148 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b4787b9-1316-4031-95b6-106e5daca330 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:39.845353 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b4787b9-1316-4031-95b6-106e5daca330 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:39.853245 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8b4787b9-1316-4031-95b6-106e5daca330 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.187298 May 26 13:47:39.863159 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 245/489] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:39 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:39.897486 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7779e1eb-2f87-49d8-9214-f92daec33e8d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:39.898089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7779e1eb-2f87-49d8-9214-f92daec33e8d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:39.904882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7779e1eb-2f87-49d8-9214-f92daec33e8d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:39.905338 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7779e1eb-2f87-49d8-9214-f92daec33e8d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:39.906133 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7779e1eb-2f87-49d8-9214-f92daec33e8d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:39.906702 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7779e1eb-2f87-49d8-9214-f92daec33e8d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:40.080349 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7779e1eb-2f87-49d8-9214-f92daec33e8d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:40.090315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7779e1eb-2f87-49d8-9214-f92daec33e8d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.196937 May 26 13:47:40.090906 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3daa8f51-dcc7-417a-be16-0999b548b4ad tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:40.091481 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 245/490] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:39 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:40.091848 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3daa8f51-dcc7-417a-be16-0999b548b4ad tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:40.099995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3daa8f51-dcc7-417a-be16-0999b548b4ad tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:40.101103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3daa8f51-dcc7-417a-be16-0999b548b4ad tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:40.102326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3daa8f51-dcc7-417a-be16-0999b548b4ad tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:40.102844 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3daa8f51-dcc7-417a-be16-0999b548b4ad tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:40.279187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3daa8f51-dcc7-417a-be16-0999b548b4ad tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:40.288699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3daa8f51-dcc7-417a-be16-0999b548b4ad tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.201873 May 26 13:47:40.289946 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 246/491] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:40 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:40.611847 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9220002a-a10f-42de-973b-1c7d95231a63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:40.612632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9220002a-a10f-42de-973b-1c7d95231a63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:40.621807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9220002a-a10f-42de-973b-1c7d95231a63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:40.622256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9220002a-a10f-42de-973b-1c7d95231a63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:40.623064 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9220002a-a10f-42de-973b-1c7d95231a63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:40.623506 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9220002a-a10f-42de-973b-1c7d95231a63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:40.837971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9220002a-a10f-42de-973b-1c7d95231a63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:40.849042 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9220002a-a10f-42de-973b-1c7d95231a63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.243090 May 26 13:47:40.850305 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 246/492] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:40 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:40.870662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3d1e7a94-45c7-4841-a53e-703b436e37fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:40.871862 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3d1e7a94-45c7-4841-a53e-703b436e37fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:40.879259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d1e7a94-45c7-4841-a53e-703b436e37fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:40.880012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d1e7a94-45c7-4841-a53e-703b436e37fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:40.881015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d1e7a94-45c7-4841-a53e-703b436e37fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:40.881667 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3d1e7a94-45c7-4841-a53e-703b436e37fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:41.050232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3d1e7a94-45c7-4841-a53e-703b436e37fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:41.059564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3d1e7a94-45c7-4841-a53e-703b436e37fe tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.192719 May 26 13:47:41.070171 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 247/493] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:40 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:41.117151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8fd8e0af-ef12-4c04-8d1f-1962cb430543 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:41.119210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8fd8e0af-ef12-4c04-8d1f-1962cb430543 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:41.130493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8fd8e0af-ef12-4c04-8d1f-1962cb430543 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:41.132344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8fd8e0af-ef12-4c04-8d1f-1962cb430543 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:41.135535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8fd8e0af-ef12-4c04-8d1f-1962cb430543 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:41.136188 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8fd8e0af-ef12-4c04-8d1f-1962cb430543 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:41.309064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7db87c5f-84cc-4de6-9d8c-88760155f2bd tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:41.309786 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7db87c5f-84cc-4de6-9d8c-88760155f2bd tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:41.324230 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7db87c5f-84cc-4de6-9d8c-88760155f2bd tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:41.328749 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7db87c5f-84cc-4de6-9d8c-88760155f2bd tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:41.330017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7db87c5f-84cc-4de6-9d8c-88760155f2bd tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:41.331310 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7db87c5f-84cc-4de6-9d8c-88760155f2bd tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:41.350558 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8fd8e0af-ef12-4c04-8d1f-1962cb430543 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:41.356747 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:41.366591 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8fd8e0af-ef12-4c04-8d1f-1962cb430543 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.260880 May 26 13:47:41.369201 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 247/494] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:41 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:41.516050 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7db87c5f-84cc-4de6-9d8c-88760155f2bd tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:41.529748 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7db87c5f-84cc-4de6-9d8c-88760155f2bd tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.226892 May 26 13:47:41.530673 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 248/495] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:41 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:41.868514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-128d26b4-1cf3-4010-83c6-26f31a5505cb tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:41.869181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-128d26b4-1cf3-4010-83c6-26f31a5505cb tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:41.876595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-128d26b4-1cf3-4010-83c6-26f31a5505cb tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:41.877355 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-128d26b4-1cf3-4010-83c6-26f31a5505cb tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:41.878177 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-128d26b4-1cf3-4010-83c6-26f31a5505cb tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:41.878620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-128d26b4-1cf3-4010-83c6-26f31a5505cb tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:42.049575 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-128d26b4-1cf3-4010-83c6-26f31a5505cb tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:42.057144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-128d26b4-1cf3-4010-83c6-26f31a5505cb tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.193824 May 26 13:47:42.057741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 248/496] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:41 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:42.077525 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-84203393-0202-4f8d-ba06-165cc703337e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:42.078224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-84203393-0202-4f8d-ba06-165cc703337e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:42.090925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84203393-0202-4f8d-ba06-165cc703337e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:42.091643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84203393-0202-4f8d-ba06-165cc703337e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:42.092670 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84203393-0202-4f8d-ba06-165cc703337e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:42.093250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84203393-0202-4f8d-ba06-165cc703337e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:42.242981 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-84203393-0202-4f8d-ba06-165cc703337e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:42.251368 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-84203393-0202-4f8d-ba06-165cc703337e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.177942 May 26 13:47:42.251956 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 249/497] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:42 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:42.384333 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-191f406d-5854-4518-bda9-086f18572217 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:42.385109 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-191f406d-5854-4518-bda9-086f18572217 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:42.392185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-191f406d-5854-4518-bda9-086f18572217 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:42.392934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-191f406d-5854-4518-bda9-086f18572217 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:42.393910 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-191f406d-5854-4518-bda9-086f18572217 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:42.394586 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-191f406d-5854-4518-bda9-086f18572217 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:42.546240 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44cba534-895b-4693-9754-84d6b7260047 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:42.547861 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-44cba534-895b-4693-9754-84d6b7260047 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:42.550976 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-191f406d-5854-4518-bda9-086f18572217 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:42.554619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44cba534-895b-4693-9754-84d6b7260047 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:42.555257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44cba534-895b-4693-9754-84d6b7260047 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:42.557938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44cba534-895b-4693-9754-84d6b7260047 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:42.558706 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44cba534-895b-4693-9754-84d6b7260047 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:42.566291 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-191f406d-5854-4518-bda9-086f18572217 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.182361 May 26 13:47:42.576522 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 249/498] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:42 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:42.736980 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44cba534-895b-4693-9754-84d6b7260047 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:42.749851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44cba534-895b-4693-9754-84d6b7260047 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.207528 May 26 13:47:42.750495 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 250/499] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:42 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:43.075051 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-39e53208-772f-4157-8c49-76d02bb57c63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:43.075837 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-39e53208-772f-4157-8c49-76d02bb57c63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:43.083326 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-39e53208-772f-4157-8c49-76d02bb57c63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:43.083844 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-39e53208-772f-4157-8c49-76d02bb57c63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:43.084873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-39e53208-772f-4157-8c49-76d02bb57c63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:43.085416 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-39e53208-772f-4157-8c49-76d02bb57c63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:43.249339 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-39e53208-772f-4157-8c49-76d02bb57c63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:43.259396 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-39e53208-772f-4157-8c49-76d02bb57c63 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.188554 May 26 13:47:43.260563 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 250/500] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:43 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:43.282659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d294ec13-96f0-411f-bcca-414558391ecc tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:43.284767 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d294ec13-96f0-411f-bcca-414558391ecc tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:43.301422 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d294ec13-96f0-411f-bcca-414558391ecc tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:43.302399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d294ec13-96f0-411f-bcca-414558391ecc tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:43.303737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d294ec13-96f0-411f-bcca-414558391ecc tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:43.304778 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d294ec13-96f0-411f-bcca-414558391ecc tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:43.583280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1cfef70d-8c31-46f1-ac22-5b9b003b51de tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:43.583801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1cfef70d-8c31-46f1-ac22-5b9b003b51de tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:43.590386 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1cfef70d-8c31-46f1-ac22-5b9b003b51de tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:43.591092 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1cfef70d-8c31-46f1-ac22-5b9b003b51de tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:43.592093 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1cfef70d-8c31-46f1-ac22-5b9b003b51de tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:43.592772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1cfef70d-8c31-46f1-ac22-5b9b003b51de tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:43.744153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d294ec13-96f0-411f-bcca-414558391ecc tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:43.753190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1cfef70d-8c31-46f1-ac22-5b9b003b51de tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:43.757643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d294ec13-96f0-411f-bcca-414558391ecc tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.483974 May 26 13:47:43.762918 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1cfef70d-8c31-46f1-ac22-5b9b003b51de tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.183655 May 26 13:47:43.772727 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 251/501] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:43 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:43.772939 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 251/502] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:43 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:43.773219 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e469dd55-6127-42e9-9158-07f5a966c1d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:43.773837 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e469dd55-6127-42e9-9158-07f5a966c1d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:43.784880 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e469dd55-6127-42e9-9158-07f5a966c1d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:43.785496 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e469dd55-6127-42e9-9158-07f5a966c1d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:43.786554 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e469dd55-6127-42e9-9158-07f5a966c1d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:43.787178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e469dd55-6127-42e9-9158-07f5a966c1d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:43.950909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e469dd55-6127-42e9-9158-07f5a966c1d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:43.959728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e469dd55-6127-42e9-9158-07f5a966c1d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.193097 May 26 13:47:43.960310 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 252/503] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:43 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:44.276614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0ee1ab25-26c9-4d74-ab5e-c27c925e0370 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:44.277555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0ee1ab25-26c9-4d74-ab5e-c27c925e0370 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:44.280807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:44.286965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ee1ab25-26c9-4d74-ab5e-c27c925e0370 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:44.288075 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ee1ab25-26c9-4d74-ab5e-c27c925e0370 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:44.289084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ee1ab25-26c9-4d74-ab5e-c27c925e0370 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:44.289506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ee1ab25-26c9-4d74-ab5e-c27c925e0370 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:44.479734 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0ee1ab25-26c9-4d74-ab5e-c27c925e0370 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:44.490487 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0ee1ab25-26c9-4d74-ab5e-c27c925e0370 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.217757 May 26 13:47:44.492669 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 252/504] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:44 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:44.785210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6be13a6b-e3f7-40ac-b12c-95c7d2b2c9a2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:44.785847 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6be13a6b-e3f7-40ac-b12c-95c7d2b2c9a2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:44.789740 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64b7d94d-cf96-42bd-987e-36b51ab0f908 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:44.791250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64b7d94d-cf96-42bd-987e-36b51ab0f908 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:44.803687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6be13a6b-e3f7-40ac-b12c-95c7d2b2c9a2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:44.807571 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64b7d94d-cf96-42bd-987e-36b51ab0f908 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:44.808787 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64b7d94d-cf96-42bd-987e-36b51ab0f908 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:44.809755 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64b7d94d-cf96-42bd-987e-36b51ab0f908 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:44.810897 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6be13a6b-e3f7-40ac-b12c-95c7d2b2c9a2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:44.811719 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6be13a6b-e3f7-40ac-b12c-95c7d2b2c9a2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:44.812234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6be13a6b-e3f7-40ac-b12c-95c7d2b2c9a2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:44.813534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64b7d94d-cf96-42bd-987e-36b51ab0f908 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:45.144813 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-64b7d94d-cf96-42bd-987e-36b51ab0f908 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:45.151191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6be13a6b-e3f7-40ac-b12c-95c7d2b2c9a2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:45.158542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64b7d94d-cf96-42bd-987e-36b51ab0f908 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.379418 May 26 13:47:45.161223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 253/505] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:44 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:45.161440 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6be13a6b-e3f7-40ac-b12c-95c7d2b2c9a2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.388193 May 26 13:47:45.162260 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 253/506] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:44 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:45.174214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-39590bff-a5d5-40cb-8338-1c6b8c818109 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:45.174817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-39590bff-a5d5-40cb-8338-1c6b8c818109 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:45.190201 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39590bff-a5d5-40cb-8338-1c6b8c818109 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:45.190658 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39590bff-a5d5-40cb-8338-1c6b8c818109 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:45.192252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39590bff-a5d5-40cb-8338-1c6b8c818109 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:45.192949 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39590bff-a5d5-40cb-8338-1c6b8c818109 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:45.235604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:45.515197 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-377916c2-f81f-4604-b96a-5427ec40d6c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:45.517086 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-377916c2-f81f-4604-b96a-5427ec40d6c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:45.532791 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-377916c2-f81f-4604-b96a-5427ec40d6c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:45.534392 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-377916c2-f81f-4604-b96a-5427ec40d6c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:45.535907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-377916c2-f81f-4604-b96a-5427ec40d6c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:45.536688 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-377916c2-f81f-4604-b96a-5427ec40d6c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:45.590954 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-39590bff-a5d5-40cb-8338-1c6b8c818109 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:45.604322 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-39590bff-a5d5-40cb-8338-1c6b8c818109 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.441947 May 26 13:47:45.606771 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 254/507] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:45 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:45.766458 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-377916c2-f81f-4604-b96a-5427ec40d6c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:45.775953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-377916c2-f81f-4604-b96a-5427ec40d6c1 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.266365 May 26 13:47:45.787943 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 254/508] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:45 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:46.180160 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-cee723c7-e776-4eb7-b695-f02dee130bef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:46.181103 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-cee723c7-e776-4eb7-b695-f02dee130bef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:46.182877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fe6f04c0-c23d-4260-b1d9-5a7141058b3d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:46.183797 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fe6f04c0-c23d-4260-b1d9-5a7141058b3d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:46.190710 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cee723c7-e776-4eb7-b695-f02dee130bef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:46.191668 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cee723c7-e776-4eb7-b695-f02dee130bef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:46.194226 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cee723c7-e776-4eb7-b695-f02dee130bef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:46.195805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cee723c7-e776-4eb7-b695-f02dee130bef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:46.196533 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe6f04c0-c23d-4260-b1d9-5a7141058b3d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:46.198452 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe6f04c0-c23d-4260-b1d9-5a7141058b3d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:46.200726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe6f04c0-c23d-4260-b1d9-5a7141058b3d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:46.201993 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe6f04c0-c23d-4260-b1d9-5a7141058b3d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:46.482630 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-cee723c7-e776-4eb7-b695-f02dee130bef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:46.491952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-cee723c7-e776-4eb7-b695-f02dee130bef tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.315920 May 26 13:47:46.497189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 255/509] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:46 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:46.629124 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ecb16aef-fe1a-4896-a1f9-419951a2a66a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:46.630033 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ecb16aef-fe1a-4896-a1f9-419951a2a66a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:46.654134 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ecb16aef-fe1a-4896-a1f9-419951a2a66a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:46.658151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ecb16aef-fe1a-4896-a1f9-419951a2a66a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:46.660949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ecb16aef-fe1a-4896-a1f9-419951a2a66a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:46.662271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ecb16aef-fe1a-4896-a1f9-419951a2a66a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:46.704619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe6f04c0-c23d-4260-b1d9-5a7141058b3d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:46.713967 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fe6f04c0-c23d-4260-b1d9-5a7141058b3d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1357 microversion: 2.1 time: 0.537606 May 26 13:47:46.716944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 255/510] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:46 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1357 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:46.796821 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0c511eb5-64a0-403d-bddb-f66abbd8e263 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:46.797818 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0c511eb5-64a0-403d-bddb-f66abbd8e263 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:46.813977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c511eb5-64a0-403d-bddb-f66abbd8e263 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:46.814594 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c511eb5-64a0-403d-bddb-f66abbd8e263 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:46.819090 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c511eb5-64a0-403d-bddb-f66abbd8e263 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:46.820955 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0c511eb5-64a0-403d-bddb-f66abbd8e263 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:46.959352 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ecb16aef-fe1a-4896-a1f9-419951a2a66a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:46.967765 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ecb16aef-fe1a-4896-a1f9-419951a2a66a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.346836 May 26 13:47:46.978234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 256/511] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:46 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:47.091538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0c511eb5-64a0-403d-bddb-f66abbd8e263 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:47.105831 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0c511eb5-64a0-403d-bddb-f66abbd8e263 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.312409 May 26 13:47:47.111363 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 256/512] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:46 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:47.295714 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-0f87d8d2-3265-432a-a149-8e9227164415 req-6a67fd1d-2af9-4b46-baa9-3230e4edadc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d71f53-7765-4d4a-88db-e17c8171cc2e", "name": "network-vif-plugged", "status": "completed", "tag": "dafda896-9068-4de0-b958-2ee4214d91ff"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:47.311178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-0f87d8d2-3265-432a-a149-8e9227164415 req-6a67fd1d-2af9-4b46-baa9-3230e4edadc7 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.312122 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-0f87d8d2-3265-432a-a149-8e9227164415 req-6a67fd1d-2af9-4b46-baa9-3230e4edadc7 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:47.333665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-0f87d8d2-3265-432a-a149-8e9227164415 req-6a67fd1d-2af9-4b46-baa9-3230e4edadc7 service nova] Creating event network-vif-plugged:dafda896-9068-4de0-b958-2ee4214d91ff for instance d5d71f53-7765-4d4a-88db-e17c8171cc2e on hv-cinder-81966 May 26 13:47:47.349829 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-0f87d8d2-3265-432a-a149-8e9227164415 req-6a67fd1d-2af9-4b46-baa9-3230e4edadc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056826 May 26 13:47:47.351673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 257/513] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:47:47.514713 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4885803-f56a-411c-a2b5-2b8cb2cba1ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:47.515357 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d4885803-f56a-411c-a2b5-2b8cb2cba1ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:47.522367 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4885803-f56a-411c-a2b5-2b8cb2cba1ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.523123 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4885803-f56a-411c-a2b5-2b8cb2cba1ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:47.524843 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4885803-f56a-411c-a2b5-2b8cb2cba1ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.525622 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4885803-f56a-411c-a2b5-2b8cb2cba1ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:47.736457 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7f12b23d-530b-4cd6-8764-91cd71f69a1e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:47.737972 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7f12b23d-530b-4cd6-8764-91cd71f69a1e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:47.754729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f12b23d-530b-4cd6-8764-91cd71f69a1e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.755577 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f12b23d-530b-4cd6-8764-91cd71f69a1e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:47.756413 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f12b23d-530b-4cd6-8764-91cd71f69a1e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.759329 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f12b23d-530b-4cd6-8764-91cd71f69a1e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:47.770066 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d4885803-f56a-411c-a2b5-2b8cb2cba1ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:47.783698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d4885803-f56a-411c-a2b5-2b8cb2cba1ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.273068 May 26 13:47:47.787441 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 257/514] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:47 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:47.943092 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7f12b23d-530b-4cd6-8764-91cd71f69a1e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:47.952813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7f12b23d-530b-4cd6-8764-91cd71f69a1e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1546 microversion: 2.1 time: 0.221136 May 26 13:47:47.953460 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 258/515] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:47 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1546 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:47.976264 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c1ea58f-6a72-42c9-bddd-aac1f5776ceb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:47.976977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c1ea58f-6a72-42c9-bddd-aac1f5776ceb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:47.987811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d248953e-3eed-4dec-a6bb-463986cf6bf4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:47.988394 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1ea58f-6a72-42c9-bddd-aac1f5776ceb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.988511 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d248953e-3eed-4dec-a6bb-463986cf6bf4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:47.988622 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1ea58f-6a72-42c9-bddd-aac1f5776ceb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:47.989445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1ea58f-6a72-42c9-bddd-aac1f5776ceb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.989972 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c1ea58f-6a72-42c9-bddd-aac1f5776ceb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:47.994836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d248953e-3eed-4dec-a6bb-463986cf6bf4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.995292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d248953e-3eed-4dec-a6bb-463986cf6bf4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:47.996907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d248953e-3eed-4dec-a6bb-463986cf6bf4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:47.997352 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d248953e-3eed-4dec-a6bb-463986cf6bf4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:48.170008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d248953e-3eed-4dec-a6bb-463986cf6bf4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:48.179476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d248953e-3eed-4dec-a6bb-463986cf6bf4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.196372 May 26 13:47:48.180717 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 259/516] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:47 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:48.185455 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c1ea58f-6a72-42c9-bddd-aac1f5776ceb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:48.185755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-308e72bb-fb91-4f12-9ad1-62aed2cff913 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:48.186494 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-308e72bb-fb91-4f12-9ad1-62aed2cff913 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:48.194438 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c1ea58f-6a72-42c9-bddd-aac1f5776ceb tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1546 microversion: 2.1 time: 0.223228 May 26 13:47:48.195364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 258/517] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:47 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1546 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:48.196519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-308e72bb-fb91-4f12-9ad1-62aed2cff913 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:48.197853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-308e72bb-fb91-4f12-9ad1-62aed2cff913 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:48.198969 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-308e72bb-fb91-4f12-9ad1-62aed2cff913 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:48.199573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-308e72bb-fb91-4f12-9ad1-62aed2cff913 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:48.217124 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:48.221647 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:48.223199 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Searching by: {'deleted': False, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8'} {{(pid=124241) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 13:47:48.232649 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:48.238555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:48.239443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:48.239893 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:48.373248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.multi_cell_list [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124241) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 13:47:48.381596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-308e72bb-fb91-4f12-9ad1-62aed2cff913 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:48.389712 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-308e72bb-fb91-4f12-9ad1-62aed2cff913 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.207768 May 26 13:47:48.399720 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 260/518] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:48 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:48.489257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4b17aaaa-6a15-467a-85fc-a29119362fdf tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.275058 May 26 13:47:48.490033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 259/519] 10.222.0.16 () {58 vars in 1124 bytes} [Thu May 26 13:47:48 2022] GET /compute/v2.1/servers => generated 341 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:47:48.501619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0f76a94b-f1ea-4cf6-b31b-74c084bf4050 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:48.502237 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0f76a94b-f1ea-4cf6-b31b-74c084bf4050 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:48.509661 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0f76a94b-f1ea-4cf6-b31b-74c084bf4050 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:48.510456 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0f76a94b-f1ea-4cf6-b31b-74c084bf4050 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:48.511602 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0f76a94b-f1ea-4cf6-b31b-74c084bf4050 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:48.512103 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0f76a94b-f1ea-4cf6-b31b-74c084bf4050 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:48.662900 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0f76a94b-f1ea-4cf6-b31b-74c084bf4050 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:48.671753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0f76a94b-f1ea-4cf6-b31b-74c084bf4050 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1546 microversion: 2.1 time: 0.174515 May 26 13:47:48.673615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 261/520] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:48 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:48.807134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-43b10068-b00b-48b0-b056-cc73f12baf63 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:48.807862 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-43b10068-b00b-48b0-b056-cc73f12baf63 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:48.816486 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43b10068-b00b-48b0-b056-cc73f12baf63 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:48.819428 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43b10068-b00b-48b0-b056-cc73f12baf63 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:48.820396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43b10068-b00b-48b0-b056-cc73f12baf63 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:48.824652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43b10068-b00b-48b0-b056-cc73f12baf63 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:49.026125 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43b10068-b00b-48b0-b056-cc73f12baf63 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:49.034810 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-43b10068-b00b-48b0-b056-cc73f12baf63 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.231573 May 26 13:47:49.035414 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 260/521] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:48 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:49.197357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9ce3afd2-0fd4-4468-8265-51660794b35a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:49.198107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9ce3afd2-0fd4-4468-8265-51660794b35a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:49.207570 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9ce3afd2-0fd4-4468-8265-51660794b35a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:49.208806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9ce3afd2-0fd4-4468-8265-51660794b35a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:49.212467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9ce3afd2-0fd4-4468-8265-51660794b35a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:49.213152 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9ce3afd2-0fd4-4468-8265-51660794b35a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:49.409800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-364cc079-c21f-4b47-94f1-286c6d2baad6 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:49.410398 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-364cc079-c21f-4b47-94f1-286c6d2baad6 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:49.426730 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-364cc079-c21f-4b47-94f1-286c6d2baad6 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:49.428239 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-364cc079-c21f-4b47-94f1-286c6d2baad6 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:49.432052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-364cc079-c21f-4b47-94f1-286c6d2baad6 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:49.432522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-364cc079-c21f-4b47-94f1-286c6d2baad6 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:49.580655 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9ce3afd2-0fd4-4468-8265-51660794b35a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:49.590428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9ce3afd2-0fd4-4468-8265-51660794b35a tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.397300 May 26 13:47:49.603393 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 262/522] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:49 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:49.633851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-364cc079-c21f-4b47-94f1-286c6d2baad6 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:49.645198 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-364cc079-c21f-4b47-94f1-286c6d2baad6 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.238616 May 26 13:47:49.646382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 261/523] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:49 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:50.056338 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-72362d81-c20e-440e-84f5-0ae5e93f5c48 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:50.056959 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-72362d81-c20e-440e-84f5-0ae5e93f5c48 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:50.073323 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-72362d81-c20e-440e-84f5-0ae5e93f5c48 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:50.073604 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-72362d81-c20e-440e-84f5-0ae5e93f5c48 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:50.074571 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-72362d81-c20e-440e-84f5-0ae5e93f5c48 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:50.075175 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-72362d81-c20e-440e-84f5-0ae5e93f5c48 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:50.288652 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-72362d81-c20e-440e-84f5-0ae5e93f5c48 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:50.298781 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-72362d81-c20e-440e-84f5-0ae5e93f5c48 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.246360 May 26 13:47:50.303317 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 263/524] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:50 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:50.595296 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e131e377-677d-457d-bb0f-33d1f4258bf7 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae5100ea-6775-46be-b751-4781f37aa0b5"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:50.596688 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e131e377-677d-457d-bb0f-33d1f4258bf7 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:50.603046 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e131e377-677d-457d-bb0f-33d1f4258bf7 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:50.603701 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e131e377-677d-457d-bb0f-33d1f4258bf7 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:50.605003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e131e377-677d-457d-bb0f-33d1f4258bf7 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:50.605444 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e131e377-677d-457d-bb0f-33d1f4258bf7 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:50.610136 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-85dabfbe-6a3e-4802-82f2-b3334d43b102 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:50.611173 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-85dabfbe-6a3e-4802-82f2-b3334d43b102 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:50.617205 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-85dabfbe-6a3e-4802-82f2-b3334d43b102 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:50.617641 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-85dabfbe-6a3e-4802-82f2-b3334d43b102 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:50.618814 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-85dabfbe-6a3e-4802-82f2-b3334d43b102 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:50.619246 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-85dabfbe-6a3e-4802-82f2-b3334d43b102 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:50.767757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-85dabfbe-6a3e-4802-82f2-b3334d43b102 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:50.775260 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-85dabfbe-6a3e-4802-82f2-b3334d43b102 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.169803 May 26 13:47:50.775821 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 264/525] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:50 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:50.781029 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-476d6555-6d2e-47e6-994f-184cf1862171 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:50.781676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-476d6555-6d2e-47e6-994f-184cf1862171 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:50.788395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-476d6555-6d2e-47e6-994f-184cf1862171 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:50.788858 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-476d6555-6d2e-47e6-994f-184cf1862171 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:50.789627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-476d6555-6d2e-47e6-994f-184cf1862171 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:50.790058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-476d6555-6d2e-47e6-994f-184cf1862171 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:50.793284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:50.933366 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-476d6555-6d2e-47e6-994f-184cf1862171 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:50.940709 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-476d6555-6d2e-47e6-994f-184cf1862171 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.163860 May 26 13:47:50.941286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 265/526] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:50 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:51.318064 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-83912d97-abe0-4cbc-b397-a544c13f14b1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:51.320378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-83912d97-abe0-4cbc-b397-a544c13f14b1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:51.332544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-83912d97-abe0-4cbc-b397-a544c13f14b1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:51.333128 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-83912d97-abe0-4cbc-b397-a544c13f14b1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:51.334518 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-83912d97-abe0-4cbc-b397-a544c13f14b1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:51.335124 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-83912d97-abe0-4cbc-b397-a544c13f14b1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:51.529844 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-83912d97-abe0-4cbc-b397-a544c13f14b1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:51.539220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-83912d97-abe0-4cbc-b397-a544c13f14b1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.227523 May 26 13:47:51.540155 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 266/527] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:51 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:51.794919 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1fd752d3-bebe-4b79-af1e-5da0ff242f77 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:51.795529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1fd752d3-bebe-4b79-af1e-5da0ff242f77 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:51.808214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1fd752d3-bebe-4b79-af1e-5da0ff242f77 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:51.808689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1fd752d3-bebe-4b79-af1e-5da0ff242f77 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:51.809594 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1fd752d3-bebe-4b79-af1e-5da0ff242f77 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:51.809888 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1fd752d3-bebe-4b79-af1e-5da0ff242f77 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:52.012286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1fd752d3-bebe-4b79-af1e-5da0ff242f77 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:52.021375 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1fd752d3-bebe-4b79-af1e-5da0ff242f77 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.230172 May 26 13:47:52.022543 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 267/528] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:51 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:52.028103 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8a280d50-2a02-4cb2-a985-1df8597d26ab tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:52.028909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8a280d50-2a02-4cb2-a985-1df8597d26ab tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:52.036856 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a280d50-2a02-4cb2-a985-1df8597d26ab tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:52.037561 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a280d50-2a02-4cb2-a985-1df8597d26ab tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:52.038505 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a280d50-2a02-4cb2-a985-1df8597d26ab tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:52.039133 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a280d50-2a02-4cb2-a985-1df8597d26ab tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:52.180939 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8a280d50-2a02-4cb2-a985-1df8597d26ab tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:52.190825 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8a280d50-2a02-4cb2-a985-1df8597d26ab tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.166725 May 26 13:47:52.191868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 268/529] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:52 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:52.557203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1c98c815-6426-4356-9e2d-a93defabe181 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:52.558055 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1c98c815-6426-4356-9e2d-a93defabe181 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:52.560424 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:52.566402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1c98c815-6426-4356-9e2d-a93defabe181 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:52.567016 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1c98c815-6426-4356-9e2d-a93defabe181 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:52.567804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1c98c815-6426-4356-9e2d-a93defabe181 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:52.568243 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1c98c815-6426-4356-9e2d-a93defabe181 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:52.711939 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1c98c815-6426-4356-9e2d-a93defabe181 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:52.719984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1c98c815-6426-4356-9e2d-a93defabe181 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.166950 May 26 13:47:52.720595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 269/530] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:52 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:53.038590 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e26bfe71-58b7-40ea-9cfa-32b8cf38a492 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:53.039229 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e26bfe71-58b7-40ea-9cfa-32b8cf38a492 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:53.045277 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e26bfe71-58b7-40ea-9cfa-32b8cf38a492 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.045722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e26bfe71-58b7-40ea-9cfa-32b8cf38a492 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.046492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e26bfe71-58b7-40ea-9cfa-32b8cf38a492 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.046961 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e26bfe71-58b7-40ea-9cfa-32b8cf38a492 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.268478 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e26bfe71-58b7-40ea-9cfa-32b8cf38a492 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:53.276566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e26bfe71-58b7-40ea-9cfa-32b8cf38a492 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.241737 May 26 13:47:53.278340 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 270/531] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:53 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:53.283519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e9d347d1-c93d-4188-bfa2-244d62986774 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:53.284390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e9d347d1-c93d-4188-bfa2-244d62986774 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:53.290925 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9d347d1-c93d-4188-bfa2-244d62986774 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.291851 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9d347d1-c93d-4188-bfa2-244d62986774 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.293654 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9d347d1-c93d-4188-bfa2-244d62986774 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.294453 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e9d347d1-c93d-4188-bfa2-244d62986774 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.550033 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e9d347d1-c93d-4188-bfa2-244d62986774 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:53.559047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e9d347d1-c93d-4188-bfa2-244d62986774 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1314 microversion: 2.1 time: 0.279228 May 26 13:47:53.560514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 271/532] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:53 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:53.565637 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-7b8f26c8-215f-4aec-8a8d-2080b4cc646c req-b638eb98-dfa5-408b-bfb3-f7d2a233434d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb5af8d-022d-4708-aca9-49d3db482dcd", "name": "network-vif-plugged", "status": "completed", "tag": "04d681e3-ceab-4cf6-876e-aec8b3942d85"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:53.578486 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-7b8f26c8-215f-4aec-8a8d-2080b4cc646c req-b638eb98-dfa5-408b-bfb3-f7d2a233434d service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.579297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-7b8f26c8-215f-4aec-8a8d-2080b4cc646c req-b638eb98-dfa5-408b-bfb3-f7d2a233434d service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.593368 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-7b8f26c8-215f-4aec-8a8d-2080b4cc646c req-b638eb98-dfa5-408b-bfb3-f7d2a233434d service nova] Creating event network-vif-plugged:04d681e3-ceab-4cf6-876e-aec8b3942d85 for instance 2fb5af8d-022d-4708-aca9-49d3db482dcd on hv-cinder-81966 May 26 13:47:53.600160 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-7b8f26c8-215f-4aec-8a8d-2080b4cc646c req-b638eb98-dfa5-408b-bfb3-f7d2a233434d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038244 May 26 13:47:53.600962 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 272/533] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:47:53.739510 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fd413453-2417-46ce-a61e-8a33f90ef1ff tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:53.740225 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fd413453-2417-46ce-a61e-8a33f90ef1ff tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:53.746964 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fd413453-2417-46ce-a61e-8a33f90ef1ff tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.747417 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fd413453-2417-46ce-a61e-8a33f90ef1ff tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.748182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fd413453-2417-46ce-a61e-8a33f90ef1ff tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.748638 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fd413453-2417-46ce-a61e-8a33f90ef1ff tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.896032 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fd413453-2417-46ce-a61e-8a33f90ef1ff tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:53.904029 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fd413453-2417-46ce-a61e-8a33f90ef1ff tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1499 microversion: 2.1 time: 0.171081 May 26 13:47:53.904559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 273/534] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:53 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:53.927591 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e34d55b-48cb-480a-9e86-93318e52c002"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:53.928849 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:53.935556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.936065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.937924 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:53.938434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:53.965449 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] HTTP exception thrown: Cannot 'attach_volume' instance c6527206-c7a2-4458-97ed-915ee9b16cfb while it is in vm_state rescued May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Request method failure captured: May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: POST /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb/os-volume_attachments HTTP/1.1 May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 74 May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RbRUWuARFGkE_5vp-aUVCmAd1sOs3n7Bajq1lOXpZEUZd0FBaykhrcUrub2qPRQYXLnHjACEWP4w_Z4B9q9yTmJ2gk5KWB4cACUVTYnFQTvxh3ybkOd-tbUcxA__Sdrz4Pf61dXEV6D8lKHhkmLUd_V7SNHeFyJJ5tDhiruopzKPU May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:47:53.973218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_667a2ccd9c9045879b4b87e156997161", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: dd8055e46e6149d3897fb88af0b19d39 May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {"volumeAttachment": {"volumeId": "3e34d55b-48cb-480a-9e86-93318e52c002"}} May 26 13:47:53.974646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Cannot 'attach_volume' instance c6527206-c7a2-4458-97ed-915ee9b16cfb while it is in vm_state rescued May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'server_id': 'c6527206-c7a2-4458-97ed-915ee9b16cfb', 'body': {'volumeAttachment': {'volumeId': '3e34d55b-48cb-480a-9e86-93318e52c002'}}} May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c6527206-c7a2-4458-97ed-915ee9b16cfb in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:47:53.975613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c6527206-c7a2-4458-97ed-915ee9b16cfb while it is in vm_state rescued May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:47:53.976768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:47:53.978054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:47:53.978054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:47:53.978054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c6527206-c7a2-4458-97ed-915ee9b16cfb while it is in vm_state rescued May 26 13:47:53.978054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:47:53.978593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Returning 409 to user: Cannot 'attach_volume' instance c6527206-c7a2-4458-97ed-915ee9b16cfb while it is in vm_state rescued {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:47:53.986142 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6d8a1e7e-7312-4545-a169-c61df6af0c40 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068310 May 26 13:47:53.987683 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 274/535] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:47:53 2022] POST /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb/os-volume_attachments => generated 152 bytes in 71 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 13:47:53.998502 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c93554de-c83d-48c7-a164-9bd71184d238 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:53.999042 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c93554de-c83d-48c7-a164-9bd71184d238 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:54.010085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c93554de-c83d-48c7-a164-9bd71184d238 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.010734 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c93554de-c83d-48c7-a164-9bd71184d238 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.012563 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c93554de-c83d-48c7-a164-9bd71184d238 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.013205 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c93554de-c83d-48c7-a164-9bd71184d238 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.117607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c93554de-c83d-48c7-a164-9bd71184d238 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb/action" status: 202 len: 0 microversion: 2.1 time: 0.124458 May 26 13:47:54.118381 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 275/536] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:47:53 2022] POST /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:47:54.129476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3b483079-f456-44cf-985f-96a00a0fdca7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:54.130347 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3b483079-f456-44cf-985f-96a00a0fdca7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:54.137878 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3b483079-f456-44cf-985f-96a00a0fdca7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.138322 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3b483079-f456-44cf-985f-96a00a0fdca7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.139096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3b483079-f456-44cf-985f-96a00a0fdca7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.139535 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3b483079-f456-44cf-985f-96a00a0fdca7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.200440 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e131e377-677d-457d-bb0f-33d1f4258bf7 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "POST /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.609117 May 26 13:47:54.204383 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 262/537] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:47:50 2022] POST /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments => generated 194 bytes in 3614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:47:54.297399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ec4e4be2-43d2-4bc6-935f-76a8f7d7e6ce tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:54.298099 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ec4e4be2-43d2-4bc6-935f-76a8f7d7e6ce tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:54.307280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec4e4be2-43d2-4bc6-935f-76a8f7d7e6ce tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.307933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec4e4be2-43d2-4bc6-935f-76a8f7d7e6ce tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.309635 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec4e4be2-43d2-4bc6-935f-76a8f7d7e6ce tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.310229 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ec4e4be2-43d2-4bc6-935f-76a8f7d7e6ce tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.314079 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3b483079-f456-44cf-985f-96a00a0fdca7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:54.324854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3b483079-f456-44cf-985f-96a00a0fdca7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1507 microversion: 2.1 time: 0.199528 May 26 13:47:54.325576 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 276/538] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:54 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:54.459612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ec4e4be2-43d2-4bc6-935f-76a8f7d7e6ce tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:54.467266 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ec4e4be2-43d2-4bc6-935f-76a8f7d7e6ce tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.175394 May 26 13:47:54.467881 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 263/539] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:54 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:54.578691 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-628352d0-6e25-4ec1-9939-c2c12710ab1e tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:54.579244 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-628352d0-6e25-4ec1-9939-c2c12710ab1e tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:54.585732 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-628352d0-6e25-4ec1-9939-c2c12710ab1e tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.586204 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-628352d0-6e25-4ec1-9939-c2c12710ab1e tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.586944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-628352d0-6e25-4ec1-9939-c2c12710ab1e tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.587382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-628352d0-6e25-4ec1-9939-c2c12710ab1e tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.764438 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-628352d0-6e25-4ec1-9939-c2c12710ab1e tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:54.779342 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-628352d0-6e25-4ec1-9939-c2c12710ab1e tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1463 microversion: 2.1 time: 0.204519 May 26 13:47:54.783166 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 277/540] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:54 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1463 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:54.836011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b091bcaf-f5d2-406d-a058-e11a3d12ea14 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:54.836807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b091bcaf-f5d2-406d-a058-e11a3d12ea14 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:54.845954 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b091bcaf-f5d2-406d-a058-e11a3d12ea14 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.846679 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b091bcaf-f5d2-406d-a058-e11a3d12ea14 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.847817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b091bcaf-f5d2-406d-a058-e11a3d12ea14 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:54.848468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b091bcaf-f5d2-406d-a058-e11a3d12ea14 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:54.877416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b091bcaf-f5d2-406d-a058-e11a3d12ea14 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:47:54.996974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b091bcaf-f5d2-406d-a058-e11a3d12ea14 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 204 len: 0 microversion: 2.1 time: 0.164099 May 26 13:47:54.997932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 264/541] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:47:54 2022] DELETE /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:47:55.009030 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-93c6d0ba-068e-4683-a340-0b23ca8204e8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:55.009376 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-93c6d0ba-068e-4683-a340-0b23ca8204e8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:55.017198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-93c6d0ba-068e-4683-a340-0b23ca8204e8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:55.017940 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-93c6d0ba-068e-4683-a340-0b23ca8204e8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:55.018924 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-93c6d0ba-068e-4683-a340-0b23ca8204e8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:55.019369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-93c6d0ba-068e-4683-a340-0b23ca8204e8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:55.168262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-93c6d0ba-068e-4683-a340-0b23ca8204e8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:55.177199 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-93c6d0ba-068e-4683-a340-0b23ca8204e8 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1469 microversion: 2.1 time: 0.174723 May 26 13:47:55.177901 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 278/542] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:55 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:55.345036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf9f8816-dd3c-446b-830e-f65a4555245b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:55.346301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bf9f8816-dd3c-446b-830e-f65a4555245b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:55.356164 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf9f8816-dd3c-446b-830e-f65a4555245b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:55.357033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf9f8816-dd3c-446b-830e-f65a4555245b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:55.358754 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf9f8816-dd3c-446b-830e-f65a4555245b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:55.360103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bf9f8816-dd3c-446b-830e-f65a4555245b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:55.484278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-921b9f61-393d-4649-8610-fee53881c918 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:55.484805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-921b9f61-393d-4649-8610-fee53881c918 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:55.491825 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-921b9f61-393d-4649-8610-fee53881c918 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:55.492409 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-921b9f61-393d-4649-8610-fee53881c918 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:55.493188 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-921b9f61-393d-4649-8610-fee53881c918 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:55.493619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-921b9f61-393d-4649-8610-fee53881c918 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:55.521079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bf9f8816-dd3c-446b-830e-f65a4555245b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:55.532400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf9f8816-dd3c-446b-830e-f65a4555245b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1507 microversion: 2.1 time: 0.191919 May 26 13:47:55.533779 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 265/543] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:55 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:55.652588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-921b9f61-393d-4649-8610-fee53881c918 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:55.662754 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-921b9f61-393d-4649-8610-fee53881c918 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.182347 May 26 13:47:55.664663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 279/544] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:55 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:56.195036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a90f10da-3aca-47ed-9643-cc87b713ef6f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:56.195756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a90f10da-3aca-47ed-9643-cc87b713ef6f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:56.202474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a90f10da-3aca-47ed-9643-cc87b713ef6f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:56.202956 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a90f10da-3aca-47ed-9643-cc87b713ef6f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:56.203992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a90f10da-3aca-47ed-9643-cc87b713ef6f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:56.204538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a90f10da-3aca-47ed-9643-cc87b713ef6f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:56.336537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a90f10da-3aca-47ed-9643-cc87b713ef6f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:56.345102 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a90f10da-3aca-47ed-9643-cc87b713ef6f tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1469 microversion: 2.1 time: 0.153757 May 26 13:47:56.345924 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 266/545] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:56 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:56.550744 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-57079302-a850-4dba-9b11-c283f34e2a0f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:56.551262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-57079302-a850-4dba-9b11-c283f34e2a0f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:56.557378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-57079302-a850-4dba-9b11-c283f34e2a0f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:56.557818 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-57079302-a850-4dba-9b11-c283f34e2a0f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:56.558572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-57079302-a850-4dba-9b11-c283f34e2a0f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:56.559000 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-57079302-a850-4dba-9b11-c283f34e2a0f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:56.681027 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d7a2bb9-60d9-4ee0-adca-cbfe745816d0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:56.681629 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d7a2bb9-60d9-4ee0-adca-cbfe745816d0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:56.688652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d7a2bb9-60d9-4ee0-adca-cbfe745816d0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:56.689839 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d7a2bb9-60d9-4ee0-adca-cbfe745816d0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:56.690626 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d7a2bb9-60d9-4ee0-adca-cbfe745816d0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:56.691073 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d7a2bb9-60d9-4ee0-adca-cbfe745816d0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:56.700793 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-57079302-a850-4dba-9b11-c283f34e2a0f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:56.711566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-57079302-a850-4dba-9b11-c283f34e2a0f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1507 microversion: 2.1 time: 0.164871 May 26 13:47:56.712533 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 280/546] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:56 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:56.881055 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9d7a2bb9-60d9-4ee0-adca-cbfe745816d0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:56.883383 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:56.890970 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d7a2bb9-60d9-4ee0-adca-cbfe745816d0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1261 microversion: 2.1 time: 0.213490 May 26 13:47:56.891753 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 267/547] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:56 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1261 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:47:57.364404 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-77e2ddfa-10ef-4d45-87b9-1a3f98ef9237 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:57.365068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-77e2ddfa-10ef-4d45-87b9-1a3f98ef9237 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:57.371718 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-77e2ddfa-10ef-4d45-87b9-1a3f98ef9237 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:57.372168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-77e2ddfa-10ef-4d45-87b9-1a3f98ef9237 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:57.372985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-77e2ddfa-10ef-4d45-87b9-1a3f98ef9237 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:57.373792 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-77e2ddfa-10ef-4d45-87b9-1a3f98ef9237 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:57.538836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-77e2ddfa-10ef-4d45-87b9-1a3f98ef9237 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:57.541590 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:57.549293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-77e2ddfa-10ef-4d45-87b9-1a3f98ef9237 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1469 microversion: 2.1 time: 0.188966 May 26 13:47:57.550189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 281/548] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:57 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:57.728927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e09f75c6-a111-4865-9cd4-f2d10ae00008 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:57.729526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e09f75c6-a111-4865-9cd4-f2d10ae00008 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:57.736895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e09f75c6-a111-4865-9cd4-f2d10ae00008 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:57.737367 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e09f75c6-a111-4865-9cd4-f2d10ae00008 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:57.738139 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e09f75c6-a111-4865-9cd4-f2d10ae00008 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:57.738534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e09f75c6-a111-4865-9cd4-f2d10ae00008 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:57.922393 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-96bf990b-6971-466e-bb5d-726e1e8431d1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:57.924033 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-96bf990b-6971-466e-bb5d-726e1e8431d1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:57.933434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-96bf990b-6971-466e-bb5d-726e1e8431d1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:57.933874 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-96bf990b-6971-466e-bb5d-726e1e8431d1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:57.934686 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-96bf990b-6971-466e-bb5d-726e1e8431d1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:57.935076 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-96bf990b-6971-466e-bb5d-726e1e8431d1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:57.957877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e09f75c6-a111-4865-9cd4-f2d10ae00008 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:57.965929 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e09f75c6-a111-4865-9cd4-f2d10ae00008 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1507 microversion: 2.1 time: 0.240765 May 26 13:47:57.966603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 268/549] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:57 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:58.075574 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-5b5e1353-73c2-4c78-90b7-0abee09ec05e req-37507952-c424-4b47-9a42-4fa34a2a3333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d71f53-7765-4d4a-88db-e17c8171cc2e", "name": "network-vif-deleted", "tag": "dafda896-9068-4de0-b958-2ee4214d91ff"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:47:58.084195 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-5b5e1353-73c2-4c78-90b7-0abee09ec05e req-37507952-c424-4b47-9a42-4fa34a2a3333 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:58.084861 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-5b5e1353-73c2-4c78-90b7-0abee09ec05e req-37507952-c424-4b47-9a42-4fa34a2a3333 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:58.098380 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-96bf990b-6971-466e-bb5d-726e1e8431d1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:58.100839 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-5b5e1353-73c2-4c78-90b7-0abee09ec05e req-37507952-c424-4b47-9a42-4fa34a2a3333 service nova] Creating event network-vif-deleted:dafda896-9068-4de0-b958-2ee4214d91ff for instance d5d71f53-7765-4d4a-88db-e17c8171cc2e on hv-cinder-81966 May 26 13:47:58.108264 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-5b5e1353-73c2-4c78-90b7-0abee09ec05e req-37507952-c424-4b47-9a42-4fa34a2a3333 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036479 May 26 13:47:58.110040 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 269/550] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:47:58.110980 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-96bf990b-6971-466e-bb5d-726e1e8431d1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1446 microversion: 2.1 time: 0.207330 May 26 13:47:58.122258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 282/551] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:57 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1446 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:58.138442 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0fa8b539-5458-4d5d-82cf-a34c00875a00 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:58.139231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0fa8b539-5458-4d5d-82cf-a34c00875a00 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:58.148250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fa8b539-5458-4d5d-82cf-a34c00875a00 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:58.148739 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fa8b539-5458-4d5d-82cf-a34c00875a00 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:58.152784 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fa8b539-5458-4d5d-82cf-a34c00875a00 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:58.153462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fa8b539-5458-4d5d-82cf-a34c00875a00 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:58.298436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:47:58.310324 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0fa8b539-5458-4d5d-82cf-a34c00875a00 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:58.318959 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0fa8b539-5458-4d5d-82cf-a34c00875a00 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1446 microversion: 2.1 time: 0.194837 May 26 13:47:58.319547 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 270/552] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:58 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1446 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:58.567029 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:58.567645 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:58.580553 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:58.581164 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:58.581985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:58.582423 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:58.633752 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:58.634205 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:58.634861 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lazy-loading 'fault' on Instance uuid d5d71f53-7765-4d4a-88db-e17c8171cc2e {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:47:58.908031 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:58.914053 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f59f4c41-37e5-4f95-bdfa-34d6d9efc016 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1304 microversion: 2.1 time: 0.350758 May 26 13:47:58.916374 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 283/553] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:58 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1304 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:58.984866 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fe507ef2-be9b-4fff-927b-cedd9cc0f569 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:58.985573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fe507ef2-be9b-4fff-927b-cedd9cc0f569 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:58.992522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe507ef2-be9b-4fff-927b-cedd9cc0f569 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:58.992975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe507ef2-be9b-4fff-927b-cedd9cc0f569 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:58.993763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe507ef2-be9b-4fff-927b-cedd9cc0f569 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:58.994198 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe507ef2-be9b-4fff-927b-cedd9cc0f569 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:59.257368 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe507ef2-be9b-4fff-927b-cedd9cc0f569 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:47:59.265195 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fe507ef2-be9b-4fff-927b-cedd9cc0f569 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1507 microversion: 2.1 time: 0.285428 May 26 13:47:59.266047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 271/554] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:58 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:47:59.931467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:47:59.932074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:47:59.940135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:59.940623 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:59.941780 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:59.942215 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:59.981401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:47:59.981851 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:47:59.982299 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lazy-loading 'fault' on Instance uuid d5d71f53-7765-4d4a-88db-e17c8171cc2e {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:48:00.025683 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:00.034398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0866a4a1-0f2a-40f9-ae9d-ff1f53d28342 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1304 microversion: 2.1 time: 0.107270 May 26 13:48:00.035281 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 284/555] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:47:59 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:00.283302 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5d88a1f3-f537-4510-a058-f41880a3bec0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:00.283930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5d88a1f3-f537-4510-a058-f41880a3bec0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:00.290490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d88a1f3-f537-4510-a058-f41880a3bec0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:00.291232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d88a1f3-f537-4510-a058-f41880a3bec0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:00.292195 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d88a1f3-f537-4510-a058-f41880a3bec0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:00.292690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d88a1f3-f537-4510-a058-f41880a3bec0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:00.526968 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5d88a1f3-f537-4510-a058-f41880a3bec0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:00.535588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5d88a1f3-f537-4510-a058-f41880a3bec0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1507 microversion: 2.1 time: 0.256708 May 26 13:48:00.536110 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 272/556] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:00 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:00.844090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-389a3153-ea37-4014-ad9b-3663b11f1dc9 req-75cb7813-a5d9-4036-bc68-7e122d3669e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb5af8d-022d-4708-aca9-49d3db482dcd", "tag": "04d681e3-ceab-4cf6-876e-aec8b3942d85"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:00.852663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-389a3153-ea37-4014-ad9b-3663b11f1dc9 req-75cb7813-a5d9-4036-bc68-7e122d3669e6 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:00.853228 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-389a3153-ea37-4014-ad9b-3663b11f1dc9 req-75cb7813-a5d9-4036-bc68-7e122d3669e6 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:00.864579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-389a3153-ea37-4014-ad9b-3663b11f1dc9 req-75cb7813-a5d9-4036-bc68-7e122d3669e6 service nova] Creating event network-changed:04d681e3-ceab-4cf6-876e-aec8b3942d85 for instance 2fb5af8d-022d-4708-aca9-49d3db482dcd on hv-cinder-81966 May 26 13:48:00.869965 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-389a3153-ea37-4014-ad9b-3663b11f1dc9 req-75cb7813-a5d9-4036-bc68-7e122d3669e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029454 May 26 13:48:00.870985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 285/557] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:01.053136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:01.053792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:01.061519 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:01.062895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:01.064018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:01.064745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:01.099009 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:01.099482 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:01.099947 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lazy-loading 'fault' on Instance uuid d5d71f53-7765-4d4a-88db-e17c8171cc2e {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:48:01.143399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:01.151201 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b73ab432-8f67-49c5-85a2-c57e85fa2f68 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1304 microversion: 2.1 time: 0.103008 May 26 13:48:01.151845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 273/558] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:01 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:01.555061 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f9a715bb-7df1-469f-b85e-ab94a6fc099a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:01.556062 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f9a715bb-7df1-469f-b85e-ab94a6fc099a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:01.563892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f9a715bb-7df1-469f-b85e-ab94a6fc099a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:01.564359 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f9a715bb-7df1-469f-b85e-ab94a6fc099a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:01.565192 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f9a715bb-7df1-469f-b85e-ab94a6fc099a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:01.565628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f9a715bb-7df1-469f-b85e-ab94a6fc099a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:01.707849 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f9a715bb-7df1-469f-b85e-ab94a6fc099a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:01.715629 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f9a715bb-7df1-469f-b85e-ab94a6fc099a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1513 microversion: 2.1 time: 0.166100 May 26 13:48:01.716198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 286/559] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:01 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:02.169749 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:02.170444 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:02.177944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:02.178775 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:02.179777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:02.180468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:02.221820 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:02.222265 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:02.223044 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lazy-loading 'fault' on Instance uuid d5d71f53-7765-4d4a-88db-e17c8171cc2e {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:48:02.314931 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd8ed5659b74354bd590f8fa2d5e19a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4298aa065642c0bcfaed146905ce85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:02.322400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f42389d5-4425-420d-95e0-f56dca0edf98 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 200 len: 1304 microversion: 2.1 time: 0.156694 May 26 13:48:02.323558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 274/560] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:02 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:03.080798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-354aa49c-698d-4a26-a110-0f7bcde7fe80 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'create', calling method: .version_select at 0x7f07e04edc10>, body: {"keypair": {"name": "tempest-keypair-1661069062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFihEoWk+tJTh8q3adJpPptNgTqMQQOECWSwxEDa0z94GlPaUMPPjP1htcIzDka2wLWSVTNiR7yo3LBWsZGG/O6dd2gmw9XFY1SIkoN3heOD3K7GiekaLKYZ+reFl1FMg=="}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:03.097801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-354aa49c-698d-4a26-a110-0f7bcde7fe80 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Getting quotas for project 667a2ccd9c9045879b4b87e156997161. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:48:03.101602 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-354aa49c-698d-4a26-a110-0f7bcde7fe80 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Getting quotas for user dd8055e46e6149d3897fb88af0b19d39 and project 667a2ccd9c9045879b4b87e156997161. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:48:03.123866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-354aa49c-698d-4a26-a110-0f7bcde7fe80 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047179 May 26 13:48:03.124631 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 287/561] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:48:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:03.340093 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:03.340751 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] [instance: d5d71f53-7765-4d4a-88db-e17c8171cc2e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:03.348469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:03.348920 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:03.349688 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:03.350119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:03.364342 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] HTTP exception thrown: Instance d5d71f53-7765-4d4a-88db-e17c8171cc2e could not be found. May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Request method failure captured: May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e HTTP/1.1 May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4TcwRrtyD2_UKaAbfPvCJcvoc8wGooKZVhXeMbFuh3vj0OYBgSF9TkT98n8dyW8vs_iPcjAjqCvJ-knBiYyJ0BqntfFwYoHZVrTX5OChnFzR7i2zrw2tcxupv6ts1kk8gRbHPItM8sGCFiWsOURNOVYT5b8J3dOc3o5zsjL_JMcDCY May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 7b4298aa065642c0bcfaed146905ce85 May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesNegativeTest-178648756 May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:48:03.366032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b4298aa065642c0bcfaed146905ce85", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b4298aa065642c0bcfaed146905ce85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b4298aa065642c0bcfaed146905ce85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b4298aa065642c0bcfaed146905ce85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesNegativeTest-178648756 May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 7b4298aa065642c0bcfaed146905ce85 May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesNegativeTest-178648756 May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesNegativeTest-178648756-project May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 2cd8ed5659b74354bd590f8fa2d5e19a May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesNegativeTest-178648756-project May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance d5d71f53-7765-4d4a-88db-e17c8171cc2e could not be found. May 26 13:48:03.367745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'd5d71f53-7765-4d4a-88db-e17c8171cc2e'} May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d71f53-7765-4d4a-88db-e17c8171cc2e could not be found. May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:48:03.368637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d71f53-7765-4d4a-88db-e17c8171cc2e could not be found. May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d71f53-7765-4d4a-88db-e17c8171cc2e could not be found. May 26 13:48:03.370095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:48:03.371360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] Returning 404 to user: Instance d5d71f53-7765-4d4a-88db-e17c8171cc2e could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:48:03.371360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f47f2f2-8817-45d1-b02c-7788c96ade81 tempest-VolumesNegativeTest-178648756 tempest-VolumesNegativeTest-178648756-project] 10.222.0.16 "GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e" status: 404 len: 111 microversion: 2.1 time: 0.031277 May 26 13:48:03.371360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 275/562] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:03 2022] GET /compute/v2.1/servers/d5d71f53-7765-4d4a-88db-e17c8171cc2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:48:04.709788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-413219758", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fcfdea38-f7ed-4182-bc5e-d5404ef24e0e"}], "security_groups": [{"name": "tempest-securitygroup--117934678"}], "key_name": "tempest-keypair-1661069062", "user_data": "}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:04.979269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.network.neutron [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] validate_networks() for [('fcfdea38-f7ed-4182-bc5e-d5404ef24e0e', None, None, None, None, None)] {{(pid=124240) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:48:05.375992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Flavor limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:48:05.376583 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Image limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:48:05.377126 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Flavor pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:48:05.377603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Image pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:48:05.378084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:48:05.387151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:05.387600 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:05.388498 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:05.388937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:05.406980 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Getting quotas for project 667a2ccd9c9045879b4b87e156997161. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:48:05.411181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Getting quotas for user dd8055e46e6149d3897fb88af0b19d39 and project 667a2ccd9c9045879b4b87e156997161. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:48:05.423012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Going to run 1 instances... {{(pid=124240) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:48:05.425325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:48:05.479920 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-17592a9b-1272-4ed2-a3f5-8ef5b6ab00b3 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.774665 May 26 13:48:05.485758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 288/563] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:48:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:48:05.491890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-367101ef-099d-433b-ace5-0c207ea9fc97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:05.492540 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-367101ef-099d-433b-ace5-0c207ea9fc97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:05.550020 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-367101ef-099d-433b-ace5-0c207ea9fc97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:05.558401 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-367101ef-099d-433b-ace5-0c207ea9fc97 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1245 microversion: 2.1 time: 0.071097 May 26 13:48:05.558965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 276/564] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:05 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:06.576292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1a51f39a-f975-44d1-8fae-deb485579641 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:06.577012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1a51f39a-f975-44d1-8fae-deb485579641 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:06.584109 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1a51f39a-f975-44d1-8fae-deb485579641 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:06.584581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1a51f39a-f975-44d1-8fae-deb485579641 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:06.585379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1a51f39a-f975-44d1-8fae-deb485579641 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:06.585812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1a51f39a-f975-44d1-8fae-deb485579641 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:06.651532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1a51f39a-f975-44d1-8fae-deb485579641 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:06.660183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1a51f39a-f975-44d1-8fae-deb485579641 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1249 microversion: 2.1 time: 0.088192 May 26 13:48:06.660809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 289/565] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:06 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:07.676678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8bec6640-47a1-45f2-ae90-c6143721b297 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:07.677314 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8bec6640-47a1-45f2-ae90-c6143721b297 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:07.684470 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bec6640-47a1-45f2-ae90-c6143721b297 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:07.684918 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bec6640-47a1-45f2-ae90-c6143721b297 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:07.685672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bec6640-47a1-45f2-ae90-c6143721b297 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:07.686103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8bec6640-47a1-45f2-ae90-c6143721b297 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:07.960548 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8bec6640-47a1-45f2-ae90-c6143721b297 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:07.967939 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8bec6640-47a1-45f2-ae90-c6143721b297 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1249 microversion: 2.1 time: 0.295074 May 26 13:48:07.968595 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 277/566] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:07 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1249 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:08.985626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-139da164-e611-4282-8564-8bbcf9578f65 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:08.989673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-139da164-e611-4282-8564-8bbcf9578f65 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:08.995726 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-139da164-e611-4282-8564-8bbcf9578f65 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:08.996550 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-139da164-e611-4282-8564-8bbcf9578f65 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:08.997637 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-139da164-e611-4282-8564-8bbcf9578f65 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:08.998206 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-139da164-e611-4282-8564-8bbcf9578f65 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:09.068755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-139da164-e611-4282-8564-8bbcf9578f65 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:09.077848 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-139da164-e611-4282-8564-8bbcf9578f65 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1249 microversion: 2.1 time: 0.096870 May 26 13:48:09.078415 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 290/567] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:08 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:09.324549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7b3eead5-b21b-43c2-962c-2cf1c76c6f9d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:09.325153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7b3eead5-b21b-43c2-962c-2cf1c76c6f9d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:09.332940 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b3eead5-b21b-43c2-962c-2cf1c76c6f9d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:09.333382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b3eead5-b21b-43c2-962c-2cf1c76c6f9d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:09.334218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b3eead5-b21b-43c2-962c-2cf1c76c6f9d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:09.334845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7b3eead5-b21b-43c2-962c-2cf1c76c6f9d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:09.485963 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7b3eead5-b21b-43c2-962c-2cf1c76c6f9d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:09.494443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7b3eead5-b21b-43c2-962c-2cf1c76c6f9d tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1592 microversion: 2.1 time: 0.173876 May 26 13:48:09.495022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 278/568] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:09 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1592 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:10.096904 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-cb9cae75-4744-47cd-8916-914e7e86ddad tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:10.097780 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-cb9cae75-4744-47cd-8916-914e7e86ddad tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:10.104368 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cb9cae75-4744-47cd-8916-914e7e86ddad tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:10.104891 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cb9cae75-4744-47cd-8916-914e7e86ddad tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:10.105720 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cb9cae75-4744-47cd-8916-914e7e86ddad tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:10.106238 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cb9cae75-4744-47cd-8916-914e7e86ddad tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:10.175936 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-cb9cae75-4744-47cd-8916-914e7e86ddad tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:10.183627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-cb9cae75-4744-47cd-8916-914e7e86ddad tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1303 microversion: 2.1 time: 0.092772 May 26 13:48:10.184253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 291/569] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:10 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:11.201194 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f6bb4242-e4f8-496d-a3e2-008c2b6b5378 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:11.201817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f6bb4242-e4f8-496d-a3e2-008c2b6b5378 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:11.209284 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6bb4242-e4f8-496d-a3e2-008c2b6b5378 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:11.209945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6bb4242-e4f8-496d-a3e2-008c2b6b5378 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:11.210895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6bb4242-e4f8-496d-a3e2-008c2b6b5378 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:11.211480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6bb4242-e4f8-496d-a3e2-008c2b6b5378 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:11.705933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f6bb4242-e4f8-496d-a3e2-008c2b6b5378 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:11.714349 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f6bb4242-e4f8-496d-a3e2-008c2b6b5378 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.516833 May 26 13:48:11.715277 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 279/570] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:11 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:12.732651 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b152262c-61b2-4b66-8c09-cbb2f78de86c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:12.734706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b152262c-61b2-4b66-8c09-cbb2f78de86c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:12.741733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b152262c-61b2-4b66-8c09-cbb2f78de86c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:12.742368 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b152262c-61b2-4b66-8c09-cbb2f78de86c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:12.743306 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b152262c-61b2-4b66-8c09-cbb2f78de86c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:12.743902 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b152262c-61b2-4b66-8c09-cbb2f78de86c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:12.810606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-f7ffa9e1-01d0-4adc-ab61-b881f4ca970a req-e23185db-6ff7-4e93-87a4-ce10e14b8015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ad193e-1516-41cd-8603-74830f1c6fc7", "tag": "e0662874-78ce-4387-a824-8ab106baa767"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:12.836262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f7ffa9e1-01d0-4adc-ab61-b881f4ca970a req-e23185db-6ff7-4e93-87a4-ce10e14b8015 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:12.836837 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f7ffa9e1-01d0-4adc-ab61-b881f4ca970a req-e23185db-6ff7-4e93-87a4-ce10e14b8015 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:12.880211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-f7ffa9e1-01d0-4adc-ab61-b881f4ca970a req-e23185db-6ff7-4e93-87a4-ce10e14b8015 service nova] Creating event network-changed:e0662874-78ce-4387-a824-8ab106baa767 for instance 39ad193e-1516-41cd-8603-74830f1c6fc7 on hv-cinder-81966 May 26 13:48:12.896371 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-f7ffa9e1-01d0-4adc-ab61-b881f4ca970a req-e23185db-6ff7-4e93-87a4-ce10e14b8015 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092020 May 26 13:48:12.897252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 280/571] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:13.059157 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b152262c-61b2-4b66-8c09-cbb2f78de86c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:13.071868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b152262c-61b2-4b66-8c09-cbb2f78de86c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.339947 May 26 13:48:13.073168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 292/572] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:12 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:14.092142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a948adc1-6194-4315-b708-61202fa6560d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:14.094431 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a948adc1-6194-4315-b708-61202fa6560d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:14.101650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a948adc1-6194-4315-b708-61202fa6560d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:14.102301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a948adc1-6194-4315-b708-61202fa6560d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:14.103399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a948adc1-6194-4315-b708-61202fa6560d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:14.103901 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a948adc1-6194-4315-b708-61202fa6560d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:14.255290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-15a7a79a-5d8a-4e8e-b2dc-fc8eb8bcdd76 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1468382374"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:14.255849 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-15a7a79a-5d8a-4e8e-b2dc-fc8eb8bcdd76 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:14.262446 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15a7a79a-5d8a-4e8e-b2dc-fc8eb8bcdd76 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:14.262903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15a7a79a-5d8a-4e8e-b2dc-fc8eb8bcdd76 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:14.263675 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15a7a79a-5d8a-4e8e-b2dc-fc8eb8bcdd76 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:14.264114 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15a7a79a-5d8a-4e8e-b2dc-fc8eb8bcdd76 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:14.287304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a948adc1-6194-4315-b708-61202fa6560d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:14.295268 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a948adc1-6194-4315-b708-61202fa6560d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.209275 May 26 13:48:14.295934 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 281/573] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:14 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:14.397335 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.network.security_group_api [None req-15a7a79a-5d8a-4e8e-b2dc-fc8eb8bcdd76 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Adding security group 4fef4f7b-39dd-464a-8c6c-49f468a88961 to port e0662874-78ce-4387-a824-8ab106baa767 May 26 13:48:14.796015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-15a7a79a-5d8a-4e8e-b2dc-fc8eb8bcdd76 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "POST /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.544772 May 26 13:48:14.797141 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 293/574] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:48:14 2022] POST /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 13:48:14.812999 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-907150e3-80e0-4775-b689-930016698154 req-922ce58b-9c49-45ec-9ec8-a34ccb4e2aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ad193e-1516-41cd-8603-74830f1c6fc7", "tag": "e0662874-78ce-4387-a824-8ab106baa767"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:14.814420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-838a905e-0fe8-4af9-9500-2661227069c0 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:14.815073 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-838a905e-0fe8-4af9-9500-2661227069c0 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:14.822523 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:14.833462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-907150e3-80e0-4775-b689-930016698154 req-922ce58b-9c49-45ec-9ec8-a34ccb4e2aaf service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:14.837253 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-838a905e-0fe8-4af9-9500-2661227069c0 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:14.837967 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-838a905e-0fe8-4af9-9500-2661227069c0 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:14.838731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-838a905e-0fe8-4af9-9500-2661227069c0 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:14.839160 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-838a905e-0fe8-4af9-9500-2661227069c0 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:14.839870 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-907150e3-80e0-4775-b689-930016698154 req-922ce58b-9c49-45ec-9ec8-a34ccb4e2aaf service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:14.859829 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-907150e3-80e0-4775-b689-930016698154 req-922ce58b-9c49-45ec-9ec8-a34ccb4e2aaf service nova] Creating event network-changed:e0662874-78ce-4387-a824-8ab106baa767 for instance 39ad193e-1516-41cd-8603-74830f1c6fc7 on hv-cinder-81966 May 26 13:48:14.872691 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-907150e3-80e0-4775-b689-930016698154 req-922ce58b-9c49-45ec-9ec8-a34ccb4e2aaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069235 May 26 13:48:14.874350 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 294/575] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:14.926203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-b09c8727-be0d-4101-8316-5a894c52b088 req-8eb838c6-f866-402d-a362-1f7cb483277c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda2ad3f-020c-4f84-8456-bd57ac8994a1", "tag": "8a479ff1-a45a-48a2-afb3-db2272655b74"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:14.934890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-b09c8727-be0d-4101-8316-5a894c52b088 req-8eb838c6-f866-402d-a362-1f7cb483277c service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:14.935330 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-b09c8727-be0d-4101-8316-5a894c52b088 req-8eb838c6-f866-402d-a362-1f7cb483277c service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:14.949591 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-b09c8727-be0d-4101-8316-5a894c52b088 req-8eb838c6-f866-402d-a362-1f7cb483277c service nova] Creating event network-changed:8a479ff1-a45a-48a2-afb3-db2272655b74 for instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 on hv-cinder-81966 May 26 13:48:14.955459 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-b09c8727-be0d-4101-8316-5a894c52b088 req-8eb838c6-f866-402d-a362-1f7cb483277c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046707 May 26 13:48:14.956629 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 295/576] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:15.039215 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-838a905e-0fe8-4af9-9500-2661227069c0 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:15.048758 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-838a905e-0fe8-4af9-9500-2661227069c0 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1639 microversion: 2.1 time: 0.246626 May 26 13:48:15.049585 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 282/577] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:14 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1639 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:15.313332 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2150e94c-8cfe-45bf-b7a9-abf37faa7543 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:15.314028 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2150e94c-8cfe-45bf-b7a9-abf37faa7543 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:15.330686 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2150e94c-8cfe-45bf-b7a9-abf37faa7543 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:15.331302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2150e94c-8cfe-45bf-b7a9-abf37faa7543 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:15.332325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2150e94c-8cfe-45bf-b7a9-abf37faa7543 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:15.332782 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2150e94c-8cfe-45bf-b7a9-abf37faa7543 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:15.398027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:15.419264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=10 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:15.505777 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2150e94c-8cfe-45bf-b7a9-abf37faa7543 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:15.513725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2150e94c-8cfe-45bf-b7a9-abf37faa7543 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.205149 May 26 13:48:15.515423 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 296/578] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:15 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:16.531860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1678031f-1024-4127-98f3-55c5bebf002d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:16.534327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1678031f-1024-4127-98f3-55c5bebf002d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:16.537109 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:16.542546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1678031f-1024-4127-98f3-55c5bebf002d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:16.542992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1678031f-1024-4127-98f3-55c5bebf002d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:16.543748 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1678031f-1024-4127-98f3-55c5bebf002d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:16.544175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1678031f-1024-4127-98f3-55c5bebf002d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:16.685285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1678031f-1024-4127-98f3-55c5bebf002d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:16.694895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1678031f-1024-4127-98f3-55c5bebf002d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.167388 May 26 13:48:16.695684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 283/579] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:16 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:17.712640 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-13542dfc-cfd5-4a34-9651-b71c3443bcac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:17.713248 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-13542dfc-cfd5-4a34-9651-b71c3443bcac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:17.720042 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-13542dfc-cfd5-4a34-9651-b71c3443bcac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:17.720532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-13542dfc-cfd5-4a34-9651-b71c3443bcac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:17.721311 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-13542dfc-cfd5-4a34-9651-b71c3443bcac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:17.721747 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-13542dfc-cfd5-4a34-9651-b71c3443bcac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:17.866629 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-13542dfc-cfd5-4a34-9651-b71c3443bcac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:17.875564 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-13542dfc-cfd5-4a34-9651-b71c3443bcac tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.166550 May 26 13:48:17.876155 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 297/580] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:17 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:18.893828 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70c0ae7b-8af6-4fe8-aa5a-0256ad79353b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:18.894468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70c0ae7b-8af6-4fe8-aa5a-0256ad79353b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:18.900772 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70c0ae7b-8af6-4fe8-aa5a-0256ad79353b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:18.901288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70c0ae7b-8af6-4fe8-aa5a-0256ad79353b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:18.902299 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70c0ae7b-8af6-4fe8-aa5a-0256ad79353b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:18.902948 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70c0ae7b-8af6-4fe8-aa5a-0256ad79353b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:19.240487 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70c0ae7b-8af6-4fe8-aa5a-0256ad79353b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:19.248605 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70c0ae7b-8af6-4fe8-aa5a-0256ad79353b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.359451 May 26 13:48:19.249400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 284/581] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:18 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:20.265331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-55fc7cd7-21c4-44ca-9936-54e78866816d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:20.265948 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-55fc7cd7-21c4-44ca-9936-54e78866816d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:20.272329 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-55fc7cd7-21c4-44ca-9936-54e78866816d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:20.272758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-55fc7cd7-21c4-44ca-9936-54e78866816d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:20.273567 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-55fc7cd7-21c4-44ca-9936-54e78866816d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:20.274026 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-55fc7cd7-21c4-44ca-9936-54e78866816d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:20.407782 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-55fc7cd7-21c4-44ca-9936-54e78866816d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:20.415187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-55fc7cd7-21c4-44ca-9936-54e78866816d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.154293 May 26 13:48:20.415753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 298/582] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:20 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:20.538684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1f9654c8-9b06-4b5c-b8fd-980190c5c740 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:20.539191 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1f9654c8-9b06-4b5c-b8fd-980190c5c740 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:20.545465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f9654c8-9b06-4b5c-b8fd-980190c5c740 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:20.545908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f9654c8-9b06-4b5c-b8fd-980190c5c740 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:20.546679 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f9654c8-9b06-4b5c-b8fd-980190c5c740 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:20.547110 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f9654c8-9b06-4b5c-b8fd-980190c5c740 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:20.570369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1f9654c8-9b06-4b5c-b8fd-980190c5c740 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/ips" status: 200 len: 153 microversion: 2.20 time: 0.035601 May 26 13:48:20.572781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 285/583] 10.222.0.16 () {60 vars in 1288 bytes} [Thu May 26 13:48:20 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/ips => generated 153 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:48:20.714906 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-f146d7be-0f42-4c2d-b625-e93f7dba8254 req-e5bf8f5d-0ad6-4e51-af22-75781c9ef304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda2ad3f-020c-4f84-8456-bd57ac8994a1", "name": "network-vif-plugged", "status": "completed", "tag": "8a479ff1-a45a-48a2-afb3-db2272655b74"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:20.724629 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-f146d7be-0f42-4c2d-b625-e93f7dba8254 req-e5bf8f5d-0ad6-4e51-af22-75781c9ef304 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:20.725068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-f146d7be-0f42-4c2d-b625-e93f7dba8254 req-e5bf8f5d-0ad6-4e51-af22-75781c9ef304 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:20.737971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-f146d7be-0f42-4c2d-b625-e93f7dba8254 req-e5bf8f5d-0ad6-4e51-af22-75781c9ef304 service nova] Creating event network-vif-plugged:8a479ff1-a45a-48a2-afb3-db2272655b74 for instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 on hv-cinder-81966 May 26 13:48:20.744495 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-f146d7be-0f42-4c2d-b625-e93f7dba8254 req-e5bf8f5d-0ad6-4e51-af22-75781c9ef304 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034199 May 26 13:48:20.746453 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 299/584] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:21.433022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3364ba42-42ca-46d1-b56e-963b2b4e352a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:21.433652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3364ba42-42ca-46d1-b56e-963b2b4e352a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:21.440605 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3364ba42-42ca-46d1-b56e-963b2b4e352a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:21.441092 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3364ba42-42ca-46d1-b56e-963b2b4e352a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:21.441897 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3364ba42-42ca-46d1-b56e-963b2b4e352a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:21.442354 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3364ba42-42ca-46d1-b56e-963b2b4e352a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:21.582273 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3364ba42-42ca-46d1-b56e-963b2b4e352a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:21.590930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3364ba42-42ca-46d1-b56e-963b2b4e352a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.161665 May 26 13:48:21.591549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 286/585] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:21 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:22.609235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4a9002d4-4424-4f13-8f71-5a6616246575 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:22.609932 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4a9002d4-4424-4f13-8f71-5a6616246575 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:22.611838 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:22.617165 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4a9002d4-4424-4f13-8f71-5a6616246575 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:22.617606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4a9002d4-4424-4f13-8f71-5a6616246575 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:22.618360 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4a9002d4-4424-4f13-8f71-5a6616246575 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:22.618784 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4a9002d4-4424-4f13-8f71-5a6616246575 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:22.769841 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4a9002d4-4424-4f13-8f71-5a6616246575 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:22.777517 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4a9002d4-4424-4f13-8f71-5a6616246575 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1370 microversion: 2.1 time: 0.173095 May 26 13:48:22.778099 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 300/586] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:22 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:23.669999 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d5bd229c-c77e-4e39-a8bc-a7a35cd22bbf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:23.671087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d5bd229c-c77e-4e39-a8bc-a7a35cd22bbf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:23.680575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5bd229c-c77e-4e39-a8bc-a7a35cd22bbf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:23.681029 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5bd229c-c77e-4e39-a8bc-a7a35cd22bbf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:23.682036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5bd229c-c77e-4e39-a8bc-a7a35cd22bbf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:23.682463 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5bd229c-c77e-4e39-a8bc-a7a35cd22bbf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:23.685083 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:23.708655 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-d5bd229c-c77e-4e39-a8bc-a7a35cd22bbf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lazy-loading 'flavor' on Instance uuid ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:48:23.798514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3a9e04a5-5f41-42ce-9932-9c4af6a43a29 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:23.800297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3a9e04a5-5f41-42ce-9932-9c4af6a43a29 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:23.808270 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3a9e04a5-5f41-42ce-9932-9c4af6a43a29 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:23.808995 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3a9e04a5-5f41-42ce-9932-9c4af6a43a29 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:23.810151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3a9e04a5-5f41-42ce-9932-9c4af6a43a29 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:23.810580 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3a9e04a5-5f41-42ce-9932-9c4af6a43a29 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:23.982233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3a9e04a5-5f41-42ce-9932-9c4af6a43a29 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:24.000911 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3a9e04a5-5f41-42ce-9932-9c4af6a43a29 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1563 microversion: 2.1 time: 0.208641 May 26 13:48:24.014632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 301/587] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:23 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:24.022607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-666cf5f6-3933-4d6e-ac34-4e5f6d89aa96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:24.023111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-666cf5f6-3933-4d6e-ac34-4e5f6d89aa96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:24.030302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-666cf5f6-3933-4d6e-ac34-4e5f6d89aa96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:24.030965 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-666cf5f6-3933-4d6e-ac34-4e5f6d89aa96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:24.031911 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-666cf5f6-3933-4d6e-ac34-4e5f6d89aa96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:24.032563 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-666cf5f6-3933-4d6e-ac34-4e5f6d89aa96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:24.039682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d5bd229c-c77e-4e39-a8bc-a7a35cd22bbf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/action" status: 202 len: 0 microversion: 2.20 time: 0.373596 May 26 13:48:24.050749 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 287/588] 10.222.0.16 () {62 vars in 1318 bytes} [Thu May 26 13:48:23 2022] POST /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 13:48:24.057589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:24.058914 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:24.068818 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:24.069669 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:24.071884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:24.072553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:24.084724 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:24.166151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-666cf5f6-3933-4d6e-ac34-4e5f6d89aa96 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149935 May 26 13:48:24.166824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 302/589] 10.222.0.16 () {58 vars in 1274 bytes} [Thu May 26 13:48:24 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:24.245506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:24.254578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:24.256930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:24.258458 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44118cc0-d920-4867-acfd-507eea01a4ad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.206268 May 26 13:48:24.259211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 288/590] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:24 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:25.177771 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-da05ba0d-e2b2-474d-9a39-f5e538f6ac42 req-992a559f-e9b4-4d16-ba86-8e60c32627a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda2ad3f-020c-4f84-8456-bd57ac8994a1", "tag": "8a479ff1-a45a-48a2-afb3-db2272655b74"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:25.187072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-da05ba0d-e2b2-474d-9a39-f5e538f6ac42 req-992a559f-e9b4-4d16-ba86-8e60c32627a4 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:25.187344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-da05ba0d-e2b2-474d-9a39-f5e538f6ac42 req-992a559f-e9b4-4d16-ba86-8e60c32627a4 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:25.199337 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-da05ba0d-e2b2-474d-9a39-f5e538f6ac42 req-992a559f-e9b4-4d16-ba86-8e60c32627a4 service nova] Creating event network-changed:8a479ff1-a45a-48a2-afb3-db2272655b74 for instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 on hv-cinder-81966 May 26 13:48:25.204397 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-da05ba0d-e2b2-474d-9a39-f5e538f6ac42 req-992a559f-e9b4-4d16-ba86-8e60c32627a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030654 May 26 13:48:25.205321 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 303/591] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:25.278627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:25.280649 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:25.287511 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:25.288192 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:25.289172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:25.289947 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:25.523642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:25.532341 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:25.534327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:25.535871 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a2398911-952f-4c20-9e2f-b9e0480c1bc9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.261300 May 26 13:48:25.536538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 289/592] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:25 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:26.556022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:26.556740 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:26.562955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:26.563425 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:26.564182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:26.564648 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:26.696159 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:26.704775 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:26.706308 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:26.707549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d4e285a0-acd7-4417-8757-5c74a99ae32d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.156285 May 26 13:48:26.708108 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 304/593] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:26 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:27.727381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:27.727980 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:27.735396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:27.735839 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:27.736633 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:27.737070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:27.871725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:27.879975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:27.881563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:27.882714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0bf2a170-4307-46b7-b87d-e0ba6eabef36 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.159271 May 26 13:48:27.883273 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 290/594] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:27 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:28.467981 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-437178db-d5f2-4afd-bb7f-88aab042490f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:28.468701 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-437178db-d5f2-4afd-bb7f-88aab042490f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:28.476047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-437178db-d5f2-4afd-bb7f-88aab042490f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:28.476519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-437178db-d5f2-4afd-bb7f-88aab042490f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:28.477287 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-437178db-d5f2-4afd-bb7f-88aab042490f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:28.477714 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-437178db-d5f2-4afd-bb7f-88aab042490f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:28.501671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-437178db-d5f2-4afd-bb7f-88aab042490f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/ips" status: 200 len: 146 microversion: 2.1 time: 0.037996 May 26 13:48:28.502144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 305/595] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:48:28 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:48:28.901463 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:28.901977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:28.909627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:28.910079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:28.910852 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:28.911287 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:29.041658 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:29.049968 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:29.051463 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:29.052657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-91a3fafb-9382-449b-b1bb-2186aae52210 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.155253 May 26 13:48:29.053204 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 291/596] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:28 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:30.071318 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:30.071919 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:30.079070 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:30.079510 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:30.080262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:30.080716 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:30.213111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:30.221198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:30.222708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:30.223864 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-291d6d6f-a232-4c88-a674-ee487f7e6271 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.156756 May 26 13:48:30.224501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 306/597] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:30 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:31.245931 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:31.247007 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:31.254399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:31.254841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:31.255647 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:31.256063 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:31.393288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:31.401223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:31.402743 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:31.403920 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-345e9371-3fab-4358-a3fe-47fe5833cf3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.164616 May 26 13:48:31.415387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 292/598] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:31 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:32.423687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:32.424293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:32.430839 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:32.431291 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:32.432061 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:32.432532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:32.568425 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:32.578599 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:32.580474 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:32.581756 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-982543b7-4629-49b0-b5e3-60a41a1fd43f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.162516 May 26 13:48:32.582525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 307/599] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:32 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:33.601043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:33.601737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:33.609308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:33.609784 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:33.610586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:33.611018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:33.742346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:33.750508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:33.751997 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:33.753232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6ca7ba67-2c0c-4871-9f5a-a8a1ff289ead tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.155989 May 26 13:48:33.753933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 293/600] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:33 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:34.771802 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:34.772441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:34.778931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:34.779969 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:34.780774 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:34.781214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:34.915910 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:34.925470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:34.927029 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:34.928255 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f6db16da-286e-4d70-86c9-1ba6b032dced tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.160292 May 26 13:48:34.928881 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 308/601] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:34 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:35.947378 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:35.947985 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:35.954946 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:35.955426 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:35.956285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:35.956777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:36.086234 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:36.094702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:36.096208 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:36.097404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4d205243-8179-4318-ad4b-f1dfed74368d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.154252 May 26 13:48:36.097992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 294/602] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:35 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:37.116853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:37.117557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:37.125367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:37.125811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:37.126936 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:37.127402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:37.255398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:37.263596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:37.265123 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:37.266260 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c84d4b01-9d6f-4d94-8e87-eeb8f7600bd6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.153352 May 26 13:48:37.266839 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 309/603] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:37 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:48:38.284727 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:38.285360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:38.292272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:38.292800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:38.293569 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:38.294005 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:38.429000 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:38.437700 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:38.439241 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:38.440498 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-147735c5-85cf-45d1-b568-8b75b46c1b4c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.159691 May 26 13:48:38.441062 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 295/604] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:38 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:39.244112 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-829b105f-8240-46ce-965b-fa78bdeb986d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26b3a9bd-b195-4cd8-ac58-015925d22187"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:39.246073 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-829b105f-8240-46ce-965b-fa78bdeb986d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:39.253480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-829b105f-8240-46ce-965b-fa78bdeb986d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:39.253931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-829b105f-8240-46ce-965b-fa78bdeb986d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:39.254736 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-829b105f-8240-46ce-965b-fa78bdeb986d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:39.255181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-829b105f-8240-46ce-965b-fa78bdeb986d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:39.459614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:39.460188 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:39.467599 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:39.468224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:39.469047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:39.469478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:39.517757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-829b105f-8240-46ce-965b-fa78bdeb986d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278183 May 26 13:48:39.518401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 310/605] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:48:39 2022] POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:39.632680 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:39.643851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:39.647292 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:39.649527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-01cbfa4c-7dd4-4f38-adff-2cab45869f8b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.193966 May 26 13:48:39.650551 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 296/606] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:39 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:40.672585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:40.673473 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:40.680339 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:40.680794 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:40.681610 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:40.682060 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:40.834304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:40.843461 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:40.845273 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:40.846469 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0ddf13cb-b800-4b5f-808c-7f2613d251e4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.179603 May 26 13:48:40.847240 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 311/607] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:40 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:41.865448 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:41.866088 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:41.874917 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:41.875368 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:41.876719 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:41.876719 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:42.026377 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:42.035578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:42.037213 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:42.038422 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-37dfb945-c9ba-489f-b831-19052a1813ca tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.177013 May 26 13:48:42.048736 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 297/608] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:41 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:43.059350 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:43.060018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:43.067487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:43.067936 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:43.068778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:43.069236 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:43.213562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:43.222183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:43.223681 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:43.224890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-18b68727-92a4-4675-b772-04d6d1a83f73 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.169566 May 26 13:48:43.225459 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 312/609] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:43 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:44.243304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:44.243839 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:44.250849 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:44.251287 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:44.252037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:44.252495 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:44.404411 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:44.412667 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:44.414185 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:44.415380 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c3be29a1-ebdd-4777-8f76-ac1e113003df tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.175991 May 26 13:48:44.415942 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 298/610] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:44 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:45.434436 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:45.435126 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:45.441692 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:45.442145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:45.442927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:45.443357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:45.581094 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:45.589052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:45.590540 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:45.592324 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a202c95c-e293-494a-8c12-ebe0a599f7c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.161896 May 26 13:48:45.593046 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 313/611] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:45 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:46.611930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:46.612571 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:46.615860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=34 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:46.621163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:46.621163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:46.621836 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:46.622304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:46.770874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:46.780293 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:46.781883 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:46.783075 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0fbffe93-c307-4801-b205-8aa23d2a111c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.175237 May 26 13:48:46.783649 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 299/612] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:46 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:47.801745 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:47.802352 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:47.809457 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:47.810627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:47.811302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:47.811746 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:47.987829 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:47.995902 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:47.997580 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:47.998811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c38fc3c5-b951-45e0-beaa-7703b0c0cceb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.201035 May 26 13:48:47.999367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 314/613] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:47 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:49.017950 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:49.018584 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:49.025226 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:49.025671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:49.026433 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:49.026867 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:49.170527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:49.178636 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:49.180191 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:49.181379 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e2883a89-c946-449d-a026-7f9ce27d5387 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.167447 May 26 13:48:49.181945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 300/614] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:49 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:50.210069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:50.210069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:50.212379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:50.212839 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:50.213672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:50.214144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:50.360633 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:50.373280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:50.375287 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:50.376672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-51a20d9e-b015-4788-84e5-830cabbfffa1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.179065 May 26 13:48:50.377324 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 315/615] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:50 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:51.408950 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:51.410150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:51.421476 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:51.422648 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:51.424362 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:51.425384 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:51.465845 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1c54b3e2-0e68-44dc-ad0e-a8dd71864d18 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:51.473012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1c54b3e2-0e68-44dc-ad0e-a8dd71864d18 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:51.473455 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1c54b3e2-0e68-44dc-ad0e-a8dd71864d18 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:51.565371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1c54b3e2-0e68-44dc-ad0e-a8dd71864d18 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Going to try to stop instance {{(pid=124240) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 13:48:51.633751 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1c54b3e2-0e68-44dc-ad0e-a8dd71864d18 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/action" status: 202 len: 0 microversion: 2.1 time: 0.171739 May 26 13:48:51.634810 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 316/616] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:48:51 2022] POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 13:48:51.646867 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a92e4aa2-068f-4836-ae48-f4d010a0b974 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:51.647634 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a92e4aa2-068f-4836-ae48-f4d010a0b974 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:51.658414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a92e4aa2-068f-4836-ae48-f4d010a0b974 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:51.658901 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a92e4aa2-068f-4836-ae48-f4d010a0b974 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:51.659868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a92e4aa2-068f-4836-ae48-f4d010a0b974 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:51.660595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a92e4aa2-068f-4836-ae48-f4d010a0b974 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:51.755512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:51.762020 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:51.766176 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:51.768163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:51.769535 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8b03641e-6e95-4e33-af38-16074484c554 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.368179 May 26 13:48:51.770231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 301/617] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:51 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:51.845093 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a92e4aa2-068f-4836-ae48-f4d010a0b974 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:51.854026 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a92e4aa2-068f-4836-ae48-f4d010a0b974 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.213014 May 26 13:48:51.854602 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 317/618] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:51 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:52.789397 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:52.790000 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:52.799709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:52.800149 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:52.801135 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:52.801567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:52.874828 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3e63aa39-6727-49a5-98e3-30be7abaac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:52.875564 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3e63aa39-6727-49a5-98e3-30be7abaac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:52.877978 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=36 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:52.884154 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e63aa39-6727-49a5-98e3-30be7abaac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:52.884657 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e63aa39-6727-49a5-98e3-30be7abaac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:52.885695 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e63aa39-6727-49a5-98e3-30be7abaac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:52.886135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e63aa39-6727-49a5-98e3-30be7abaac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:52.891528 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:48:52.971656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:52.984784 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:52.986263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:52.987737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b313153d-a06a-4112-af7c-a9d372b61cb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.202335 May 26 13:48:52.988339 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 302/619] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:52 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:53.085534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3e63aa39-6727-49a5-98e3-30be7abaac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:53.095286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3e63aa39-6727-49a5-98e3-30be7abaac15 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.226523 May 26 13:48:53.095876 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 318/620] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:52 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:54.009807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:54.010490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:54.018008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:54.018459 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:54.019261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:54.019772 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:54.118023 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4c4f6a72-3aaa-4977-af24-e80531cbb2da tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:54.119349 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4c4f6a72-3aaa-4977-af24-e80531cbb2da tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:54.132178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4c4f6a72-3aaa-4977-af24-e80531cbb2da tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:54.133102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4c4f6a72-3aaa-4977-af24-e80531cbb2da tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:54.135057 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4c4f6a72-3aaa-4977-af24-e80531cbb2da tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:54.136062 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4c4f6a72-3aaa-4977-af24-e80531cbb2da tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:54.177307 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:54.185927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:54.187593 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:54.188825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5e28ba3e-3ca2-4f73-815e-d1eaaecb4015 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.183277 May 26 13:48:54.190083 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 303/621] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:54 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:54.309192 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4c4f6a72-3aaa-4977-af24-e80531cbb2da tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:54.323945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4c4f6a72-3aaa-4977-af24-e80531cbb2da tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.213169 May 26 13:48:54.325996 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 319/622] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:54 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:48:55.216754 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:55.217649 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:55.224969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:55.225416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:55.226200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:55.226620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:55.347537 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c32cf855-af62-4ec9-8f55-1979be64aa52 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:55.349697 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c32cf855-af62-4ec9-8f55-1979be64aa52 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:55.381211 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c32cf855-af62-4ec9-8f55-1979be64aa52 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:55.381888 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c32cf855-af62-4ec9-8f55-1979be64aa52 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:55.392567 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c32cf855-af62-4ec9-8f55-1979be64aa52 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:55.393571 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c32cf855-af62-4ec9-8f55-1979be64aa52 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:55.450890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:55.463279 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:55.465369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:55.467271 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1f7db8b9-9f1e-45a7-a6bf-5dcec3c2a055 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.256463 May 26 13:48:55.469075 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 304/623] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:55 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:48:55.668597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c32cf855-af62-4ec9-8f55-1979be64aa52 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:55.677519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c32cf855-af62-4ec9-8f55-1979be64aa52 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.337765 May 26 13:48:55.678394 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 320/624] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:55 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:56.491044 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:56.492105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:56.503010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:56.503469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:56.504263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:56.504748 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:56.683093 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:56.698510 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-004df8f8-55fa-4027-91aa-0c29818c9ce6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:56.699553 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-004df8f8-55fa-4027-91aa-0c29818c9ce6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:56.713310 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:56.722280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-004df8f8-55fa-4027-91aa-0c29818c9ce6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:56.722998 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-004df8f8-55fa-4027-91aa-0c29818c9ce6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:56.724401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-004df8f8-55fa-4027-91aa-0c29818c9ce6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:56.725124 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-004df8f8-55fa-4027-91aa-0c29818c9ce6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:56.726445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:56.729549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f14c1394-3817-4333-9811-9b8f6b9e1c35 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.244519 May 26 13:48:56.741843 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 305/625] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:56 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:56.885421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-7008ee77-994d-4f8a-89ce-c6670ebc7d3b req-8cd906b5-d324-4e8c-87f3-37fdffc200dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef326f08-0e4f-4ad0-9f62-f4197ccf5b65", "name": "network-vif-plugged", "status": "completed", "tag": "914816b6-d98c-46f8-9da7-123cb0956236"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:48:56.895730 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-7008ee77-994d-4f8a-89ce-c6670ebc7d3b req-8cd906b5-d324-4e8c-87f3-37fdffc200dc service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:56.896279 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-7008ee77-994d-4f8a-89ce-c6670ebc7d3b req-8cd906b5-d324-4e8c-87f3-37fdffc200dc service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:56.910512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-7008ee77-994d-4f8a-89ce-c6670ebc7d3b req-8cd906b5-d324-4e8c-87f3-37fdffc200dc service nova] Creating event network-vif-plugged:914816b6-d98c-46f8-9da7-123cb0956236 for instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 on hv-cinder-81966 May 26 13:48:56.916152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-7008ee77-994d-4f8a-89ce-c6670ebc7d3b req-8cd906b5-d324-4e8c-87f3-37fdffc200dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034610 May 26 13:48:56.919490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 306/626] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:48:56.961485 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-004df8f8-55fa-4027-91aa-0c29818c9ce6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:56.971798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-004df8f8-55fa-4027-91aa-0c29818c9ce6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.280179 May 26 13:48:56.976565 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 321/627] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:56 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:57.762057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:57.762781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:57.769318 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:57.769767 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:57.770594 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:57.770976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:57.908595 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:57.917931 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:57.920475 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:57.921766 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c72a0827-2b53-45c3-a08a-332dd0a21574 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.164712 May 26 13:48:57.922509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 307/628] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:57 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:57.989240 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c4cfc1cb-9588-4389-9885-a70a7a640f81 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:57.989880 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c4cfc1cb-9588-4389-9885-a70a7a640f81 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:57.996495 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c4cfc1cb-9588-4389-9885-a70a7a640f81 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:57.996972 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c4cfc1cb-9588-4389-9885-a70a7a640f81 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:57.997745 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c4cfc1cb-9588-4389-9885-a70a7a640f81 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:57.998181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c4cfc1cb-9588-4389-9885-a70a7a640f81 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:58.134871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c4cfc1cb-9588-4389-9885-a70a7a640f81 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:58.143682 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c4cfc1cb-9588-4389-9885-a70a7a640f81 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.158214 May 26 13:48:58.144262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 322/629] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:57 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:48:58.940603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:58.941203 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:58.947843 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:58.948277 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:58.949049 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:58.949481 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:59.077149 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:59.085049 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:59.086561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:59.087708 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8e88ac71-cd6f-470c-9df1-3e2dab54ceec tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.151040 May 26 13:48:59.088269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 308/630] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:48:58 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:48:59.160065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0b1660a1-9fd1-4650-bac4-f9ae4f590e58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:48:59.160693 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0b1660a1-9fd1-4650-bac4-f9ae4f590e58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:48:59.167068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0b1660a1-9fd1-4650-bac4-f9ae4f590e58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:59.167508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0b1660a1-9fd1-4650-bac4-f9ae4f590e58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:59.168252 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0b1660a1-9fd1-4650-bac4-f9ae4f590e58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:48:59.169457 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0b1660a1-9fd1-4650-bac4-f9ae4f590e58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:48:59.296091 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0b1660a1-9fd1-4650-bac4-f9ae4f590e58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:48:59.303902 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0b1660a1-9fd1-4650-bac4-f9ae4f590e58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.147646 May 26 13:48:59.304482 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 323/631] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:48:59 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:00.108291 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:00.108969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:00.117922 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:00.118592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:00.119760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:00.120459 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:00.257290 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:00.266060 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:00.267549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:00.268732 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d5975b31-03fe-4c41-98d6-98483fa70a40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.165262 May 26 13:49:00.269293 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 309/632] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:00 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:00.321056 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a0e0c596-c701-4d83-8b25-648ecd6ca901 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:00.321694 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a0e0c596-c701-4d83-8b25-648ecd6ca901 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:00.328954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a0e0c596-c701-4d83-8b25-648ecd6ca901 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:00.329406 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a0e0c596-c701-4d83-8b25-648ecd6ca901 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:00.330187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a0e0c596-c701-4d83-8b25-648ecd6ca901 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:00.330628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a0e0c596-c701-4d83-8b25-648ecd6ca901 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:00.470487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a0e0c596-c701-4d83-8b25-648ecd6ca901 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:00.479068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a0e0c596-c701-4d83-8b25-648ecd6ca901 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.161992 May 26 13:49:00.479656 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 324/633] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:00 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:01.287306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:01.287899 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:01.295254 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:01.295704 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:01.296510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:01.296952 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:01.424974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:01.433708 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:01.435493 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:01.436685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f63c1e56-7d52-4d58-8640-3f1a83c9b513 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.153309 May 26 13:49:01.437252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 310/634] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:01 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:01.503272 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-16ff182d-9d52-4b85-ac8d-926a150b7fd5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:01.503877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-16ff182d-9d52-4b85-ac8d-926a150b7fd5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:01.510400 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-16ff182d-9d52-4b85-ac8d-926a150b7fd5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:01.510846 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-16ff182d-9d52-4b85-ac8d-926a150b7fd5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:01.511610 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-16ff182d-9d52-4b85-ac8d-926a150b7fd5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:01.512049 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-16ff182d-9d52-4b85-ac8d-926a150b7fd5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:01.647032 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-16ff182d-9d52-4b85-ac8d-926a150b7fd5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:01.655545 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-16ff182d-9d52-4b85-ac8d-926a150b7fd5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.156126 May 26 13:49:01.656115 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 325/635] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:01 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:02.456212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:02.456846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:02.463257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:02.463706 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:02.464506 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:02.464942 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:02.608889 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:02.616877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:02.618396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:02.619553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-50633ff7-e870-4f78-a1d7-716c38cd5e77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.167287 May 26 13:49:02.620116 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 311/636] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:02 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:02.673220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-97ddcc52-bf16-4443-9388-ddfdbf025e29 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:02.673860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-97ddcc52-bf16-4443-9388-ddfdbf025e29 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:02.680236 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97ddcc52-bf16-4443-9388-ddfdbf025e29 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:02.680711 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97ddcc52-bf16-4443-9388-ddfdbf025e29 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:02.681465 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97ddcc52-bf16-4443-9388-ddfdbf025e29 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:02.681899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97ddcc52-bf16-4443-9388-ddfdbf025e29 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:02.817588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-97ddcc52-bf16-4443-9388-ddfdbf025e29 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:02.826266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-97ddcc52-bf16-4443-9388-ddfdbf025e29 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.157476 May 26 13:49:02.826882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 326/637] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:02 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:03.638947 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:03.639558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:03.646427 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:03.646878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:03.647660 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:03.648109 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:03.798778 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:03.808168 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:03.810430 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:03.811647 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fe2c4dd5-8ce9-49e0-97d1-1d79261062d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1746 microversion: 2.20 time: 0.177184 May 26 13:49:03.812224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 312/638] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:03 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:03.845536 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a00c6879-69d3-4c03-a9c1-bb2531f043f5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:03.846148 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a00c6879-69d3-4c03-a9c1-bb2531f043f5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:03.854441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a00c6879-69d3-4c03-a9c1-bb2531f043f5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:03.855196 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a00c6879-69d3-4c03-a9c1-bb2531f043f5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:03.857197 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a00c6879-69d3-4c03-a9c1-bb2531f043f5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:03.857772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a00c6879-69d3-4c03-a9c1-bb2531f043f5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:04.000010 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a00c6879-69d3-4c03-a9c1-bb2531f043f5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:04.008573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a00c6879-69d3-4c03-a9c1-bb2531f043f5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.167067 May 26 13:49:04.009147 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 327/639] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:03 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:04.834567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:04.835330 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:04.845879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:04.846326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:04.847254 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:04.847810 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:05.010937 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:05.024226 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:05.026955 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:05.027105 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a1db3c83-f6cd-4a13-9337-30c4b05858a0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:05.029561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4f12271f-3171-4131-95a1-8be0ffbdbdac tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1741 microversion: 2.20 time: 0.201499 May 26 13:49:05.032703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a1db3c83-f6cd-4a13-9337-30c4b05858a0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:05.045671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 313/640] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:04 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:05.047317 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a1db3c83-f6cd-4a13-9337-30c4b05858a0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:05.047776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a1db3c83-f6cd-4a13-9337-30c4b05858a0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:05.048571 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a1db3c83-f6cd-4a13-9337-30c4b05858a0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:05.049184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a1db3c83-f6cd-4a13-9337-30c4b05858a0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:05.253506 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a1db3c83-f6cd-4a13-9337-30c4b05858a0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:05.263912 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a1db3c83-f6cd-4a13-9337-30c4b05858a0 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.240564 May 26 13:49:05.264519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 328/641] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:05 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:49:06.052848 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:06.053541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:06.061360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:06.061800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:06.062578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:06.063008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:06.284862 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-099db224-ed05-4eee-a7e6-13f642b89a4b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:06.286145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-099db224-ed05-4eee-a7e6-13f642b89a4b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:06.301628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-099db224-ed05-4eee-a7e6-13f642b89a4b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:06.302376 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-099db224-ed05-4eee-a7e6-13f642b89a4b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:06.306004 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-099db224-ed05-4eee-a7e6-13f642b89a4b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:06.306651 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-099db224-ed05-4eee-a7e6-13f642b89a4b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:06.373677 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:06.387964 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:06.389553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:06.392651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c7e17cff-a868-4779-93ca-bc679357b3c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1741 microversion: 2.20 time: 0.343638 May 26 13:49:06.394131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 314/642] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:06 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1741 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:49:06.507844 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-099db224-ed05-4eee-a7e6-13f642b89a4b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:06.520476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-099db224-ed05-4eee-a7e6-13f642b89a4b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.241524 May 26 13:49:06.521740 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 329/643] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:06 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:07.414261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:07.415130 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:07.428400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:07.429179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:07.430021 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:07.430470 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:07.540430 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bfd12088-673c-4dcf-aa0f-bbbe2324338b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:07.541069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bfd12088-673c-4dcf-aa0f-bbbe2324338b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:07.556458 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bfd12088-673c-4dcf-aa0f-bbbe2324338b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:07.560844 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bfd12088-673c-4dcf-aa0f-bbbe2324338b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:07.565611 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bfd12088-673c-4dcf-aa0f-bbbe2324338b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:07.567030 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bfd12088-673c-4dcf-aa0f-bbbe2324338b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:07.697518 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:07.727675 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:07.729630 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:07.730600 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9bee0045-1f13-4f1d-9acd-f47c1a893283 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1741 microversion: 2.20 time: 0.320508 May 26 13:49:07.731334 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 315/644] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:07 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1741 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:07.770173 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bfd12088-673c-4dcf-aa0f-bbbe2324338b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:07.778597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bfd12088-673c-4dcf-aa0f-bbbe2324338b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.242549 May 26 13:49:07.779683 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 330/645] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:07 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:08.756587 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:08.757814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:08.793958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:08.794665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:08.795618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:08.796209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:08.798087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3702584d-4034-4c4b-be4f-487be76d85bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:08.799788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3702584d-4034-4c4b-be4f-487be76d85bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:08.820019 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3702584d-4034-4c4b-be4f-487be76d85bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:08.821166 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3702584d-4034-4c4b-be4f-487be76d85bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:08.826157 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3702584d-4034-4c4b-be4f-487be76d85bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:08.828036 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3702584d-4034-4c4b-be4f-487be76d85bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:09.055694 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3702584d-4034-4c4b-be4f-487be76d85bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:09.078261 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3702584d-4034-4c4b-be4f-487be76d85bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.285279 May 26 13:49:09.080414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 331/646] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:08 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:09.087205 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:09.104062 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:09.106750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:09.107975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-74bcbaea-7412-45f3-bb4f-e2bc8607580c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1741 microversion: 2.20 time: 0.360288 May 26 13:49:09.108577 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 316/647] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:08 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1741 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:10.111611 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5afbb8bb-d310-4f85-affd-69b2f0b1009e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:10.112508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5afbb8bb-d310-4f85-affd-69b2f0b1009e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:10.120529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5afbb8bb-d310-4f85-affd-69b2f0b1009e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:10.121854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5afbb8bb-d310-4f85-affd-69b2f0b1009e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:10.122919 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5afbb8bb-d310-4f85-affd-69b2f0b1009e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:10.123551 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5afbb8bb-d310-4f85-affd-69b2f0b1009e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:10.137172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:10.137914 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:10.149492 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:10.150339 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:10.151396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:10.152054 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:10.317256 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:10.327412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:10.330590 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:10.332046 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-22094dde-3b02-41dc-b764-cce9fc07658e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1741 microversion: 2.20 time: 0.199456 May 26 13:49:10.332172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5afbb8bb-d310-4f85-affd-69b2f0b1009e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:10.333550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 317/648] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:10 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:49:10.369809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5afbb8bb-d310-4f85-affd-69b2f0b1009e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.276187 May 26 13:49:10.387921 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 332/649] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:10 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:11.362531 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:11.363795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:11.370722 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:11.371214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:11.372059 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:11.372522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:11.390570 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2717ec58-0856-40b9-905f-402dae588db2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:11.391246 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2717ec58-0856-40b9-905f-402dae588db2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:11.400631 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2717ec58-0856-40b9-905f-402dae588db2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:11.401084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2717ec58-0856-40b9-905f-402dae588db2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:11.401868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2717ec58-0856-40b9-905f-402dae588db2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:11.402937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2717ec58-0856-40b9-905f-402dae588db2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:11.545672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:11.554955 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:11.556524 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:11.557695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c0524c31-f14f-445b-beff-9c3dfe6242e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1741 microversion: 2.20 time: 0.199378 May 26 13:49:11.558574 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 318/650] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:11 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:11.572034 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2717ec58-0856-40b9-905f-402dae588db2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:11.583344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2717ec58-0856-40b9-905f-402dae588db2 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.196488 May 26 13:49:11.583992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 333/651] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:11 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:12.577466 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:12.578697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:12.587020 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:12.587478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:12.588269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:12.588757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:12.591815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=100 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:12.600275 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-51bef5a9-6d0d-48e7-b4e6-b96bdd457ae9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:12.601744 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-51bef5a9-6d0d-48e7-b4e6-b96bdd457ae9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:12.613044 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51bef5a9-6d0d-48e7-b4e6-b96bdd457ae9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:12.614024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51bef5a9-6d0d-48e7-b4e6-b96bdd457ae9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:12.615095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51bef5a9-6d0d-48e7-b4e6-b96bdd457ae9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:12.615748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-51bef5a9-6d0d-48e7-b4e6-b96bdd457ae9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:12.758465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:12.769838 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:12.773378 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:12.774620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7385d1de-eba1-4505-9de3-999d1c883e86 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1741 microversion: 2.20 time: 0.201635 May 26 13:49:12.775409 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 319/652] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:12 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:12.801462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-51bef5a9-6d0d-48e7-b4e6-b96bdd457ae9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:12.803642 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:12.812236 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-51bef5a9-6d0d-48e7-b4e6-b96bdd457ae9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1723 microversion: 2.1 time: 0.215523 May 26 13:49:12.812769 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 334/653] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:12 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:49:13.795065 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:13.795810 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:13.802536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:13.802994 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:13.803766 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:13.804467 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:13.829344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e4f524c7-3af0-42ec-987c-27e1df5e9f8b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:13.830623 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e4f524c7-3af0-42ec-987c-27e1df5e9f8b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:13.849373 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4f524c7-3af0-42ec-987c-27e1df5e9f8b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:13.849830 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4f524c7-3af0-42ec-987c-27e1df5e9f8b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:13.850620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4f524c7-3af0-42ec-987c-27e1df5e9f8b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:13.851059 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4f524c7-3af0-42ec-987c-27e1df5e9f8b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:13.976923 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:13.985687 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:13.987206 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:13.988670 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-51f35786-292e-439b-b85b-28e554c81a0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1741 microversion: 2.20 time: 0.197769 May 26 13:49:13.989010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 320/654] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:13 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:14.025378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e4f524c7-3af0-42ec-987c-27e1df5e9f8b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:14.034402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e4f524c7-3af0-42ec-987c-27e1df5e9f8b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1700 microversion: 2.1 time: 0.208700 May 26 13:49:14.034987 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 335/655] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:13 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1700 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:14.052925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f5f5f5d2-94f0-4521-9fb5-cce29af187fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:14.059313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5f5f5d2-94f0-4521-9fb5-cce29af187fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:14.059764 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f5f5f5d2-94f0-4521-9fb5-cce29af187fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:14.125795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f5f5f5d2-94f0-4521-9fb5-cce29af187fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Going to try to start instance {{(pid=124241) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 13:49:14.167900 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f5f5f5d2-94f0-4521-9fb5-cce29af187fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/action" status: 202 len: 0 microversion: 2.1 time: 0.119061 May 26 13:49:14.168579 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 321/656] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:49:14 2022] POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 13:49:14.176824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d05be57e-fdbd-430c-b21e-dabf4aae79ce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:14.177508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d05be57e-fdbd-430c-b21e-dabf4aae79ce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:14.184584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d05be57e-fdbd-430c-b21e-dabf4aae79ce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:14.185250 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d05be57e-fdbd-430c-b21e-dabf4aae79ce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:14.186136 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d05be57e-fdbd-430c-b21e-dabf4aae79ce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:14.186587 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d05be57e-fdbd-430c-b21e-dabf4aae79ce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:14.320486 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d05be57e-fdbd-430c-b21e-dabf4aae79ce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:14.332194 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d05be57e-fdbd-430c-b21e-dabf4aae79ce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1709 microversion: 2.1 time: 0.159076 May 26 13:49:14.332821 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 336/657] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:14 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1709 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:15.007588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:15.008284 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:15.015472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:15.015921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:15.016717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:15.017152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:15.148106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:15.156563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:15.158057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:15.159192 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5b41bca2-007c-4a56-86d5-0cf9be29b8ed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1723 microversion: 2.20 time: 0.155910 May 26 13:49:15.159744 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 322/658] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:15 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:15.350015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-202681db-e038-4d97-bba6-3731652dad04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:15.350630 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-202681db-e038-4d97-bba6-3731652dad04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:15.357927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-202681db-e038-4d97-bba6-3731652dad04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:15.358382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-202681db-e038-4d97-bba6-3731652dad04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:15.359383 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-202681db-e038-4d97-bba6-3731652dad04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:15.360200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-202681db-e038-4d97-bba6-3731652dad04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:15.502170 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-202681db-e038-4d97-bba6-3731652dad04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:15.510082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-202681db-e038-4d97-bba6-3731652dad04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1709 microversion: 2.1 time: 0.164073 May 26 13:49:15.510834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 337/659] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:15 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:16.178235 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:16.178783 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:16.185637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:16.186083 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:16.186856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:16.187284 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:16.341368 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:16.349376 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:16.350900 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:16.352170 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-17044fb8-a072-461f-ab9d-2bac7b2afb8d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1723 microversion: 2.20 time: 0.177921 May 26 13:49:16.352764 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 323/660] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:16 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:16.528778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-10904d67-f7aa-4007-830e-77676390256c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:16.529753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-10904d67-f7aa-4007-830e-77676390256c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:16.536445 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-10904d67-f7aa-4007-830e-77676390256c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:16.536993 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-10904d67-f7aa-4007-830e-77676390256c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:16.537771 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-10904d67-f7aa-4007-830e-77676390256c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:16.538204 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-10904d67-f7aa-4007-830e-77676390256c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:16.665816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-10904d67-f7aa-4007-830e-77676390256c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:16.674395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-10904d67-f7aa-4007-830e-77676390256c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1713 microversion: 2.1 time: 0.151078 May 26 13:49:16.674968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 338/661] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:16 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:49:17.376728 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:17.377317 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:17.380290 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=50 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:17.387481 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:17.387951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:17.388781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:17.389224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:17.527534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:17.535462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:17.537008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:17.538162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70bf2a4e-5182-4de4-98c4-25e734129c80 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1723 microversion: 2.20 time: 0.165544 May 26 13:49:17.538726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 324/662] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:17 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:18.557767 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:18.558325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:18.564919 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:18.565362 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:18.566107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:18.566536 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:18.694084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:18.702966 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:18.704529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:18.705686 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-20a228d7-0019-4935-91eb-620872c89f20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1666 microversion: 2.20 time: 0.152113 May 26 13:49:18.706245 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 339/663] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:18 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1666 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:18.723612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ea75cdcb-d957-44f8-9d7d-708d08fd383a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f0fd5d4-9365-40a4-a4af-a9cb36ef2dd2"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:18.724639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ea75cdcb-d957-44f8-9d7d-708d08fd383a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:18.731350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea75cdcb-d957-44f8-9d7d-708d08fd383a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:18.731807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea75cdcb-d957-44f8-9d7d-708d08fd383a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:18.732684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea75cdcb-d957-44f8-9d7d-708d08fd383a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:18.733118 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ea75cdcb-d957-44f8-9d7d-708d08fd383a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:18.903647 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-0336491b-c99e-40bb-b6ef-c9305652fb8b req-5d79eff3-2ce9-4af0-8e7a-4d755986209e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef326f08-0e4f-4ad0-9f62-f4197ccf5b65", "name": "network-vif-unplugged", "status": "completed", "tag": "914816b6-d98c-46f8-9da7-123cb0956236"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:18.922491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-0336491b-c99e-40bb-b6ef-c9305652fb8b req-5d79eff3-2ce9-4af0-8e7a-4d755986209e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:18.922942 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-0336491b-c99e-40bb-b6ef-c9305652fb8b req-5d79eff3-2ce9-4af0-8e7a-4d755986209e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:18.936188 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.compute.server_external_events [req-0336491b-c99e-40bb-b6ef-c9305652fb8b req-5d79eff3-2ce9-4af0-8e7a-4d755986209e service nova] Unable to find a host for instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65. Dropping event network-vif-unplugged {{(pid=124240) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 13:49:18.937221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-0336491b-c99e-40bb-b6ef-c9305652fb8b req-5d79eff3-2ce9-4af0-8e7a-4d755986209e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037907 May 26 13:49:18.937903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 340/664] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 26 13:49:19.034428 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ea75cdcb-d957-44f8-9d7d-708d08fd383a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314867 May 26 13:49:19.035087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 325/665] 10.222.0.16 () {62 vars in 1363 bytes} [Thu May 26 13:49:18 2022] POST /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:49:19.154952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a3d8a203-c8be-49fc-b886-0dc09847898a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:19.155538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a3d8a203-c8be-49fc-b886-0dc09847898a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:19.161560 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3d8a203-c8be-49fc-b886-0dc09847898a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:19.162010 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3d8a203-c8be-49fc-b886-0dc09847898a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:19.162792 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3d8a203-c8be-49fc-b886-0dc09847898a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:19.163225 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3d8a203-c8be-49fc-b886-0dc09847898a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:19.253592 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a3d8a203-c8be-49fc-b886-0dc09847898a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/action" status: 202 len: 0 microversion: 2.20 time: 0.103348 May 26 13:49:19.254172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 341/666] 10.222.0.16 () {62 vars in 1318 bytes} [Thu May 26 13:49:19 2022] POST /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 13:49:19.262470 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:19.263084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:19.269202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:19.269723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:19.270588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:19.271081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:19.409971 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:19.419264 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:19.421068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:19.422239 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b784291a-b1a9-4237-a30f-afdb35e06458 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1752 microversion: 2.20 time: 0.163994 May 26 13:49:19.422997 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 326/667] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:19 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:20.440764 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:20.441426 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:20.448572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:20.449668 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:20.450722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:20.451365 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:20.588969 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:20.597237 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:20.598755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:20.599889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0d9ee24c-5761-4924-b398-d28b22c3bb0c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1754 microversion: 2.20 time: 0.163192 May 26 13:49:20.600479 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 342/668] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:20 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:21.619635 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:21.620330 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:21.627364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:21.627813 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:21.628614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:21.629047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:21.842054 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:21.850975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:21.852513 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:21.853677 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8e6d1e35-b2e4-466b-87cc-89986b915704 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.238360 May 26 13:49:21.854232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 327/669] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:21 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:22.873692 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:22.875729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:22.883489 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:22.884270 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:22.885271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:22.885896 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:23.034598 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:23.043183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:23.044695 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:23.045863 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6143ad61-76a4-4041-9856-bc86c49e39c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.176963 May 26 13:49:23.046407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 343/670] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:22 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:24.064286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:24.064914 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:24.071643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:24.072085 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:24.072885 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:24.073322 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:24.214043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:24.223324 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:24.224850 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:24.226007 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6c44964e-76c5-4076-bbab-df02fd6721ce tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.165612 May 26 13:49:24.226570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 328/671] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:24 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:25.245585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:25.247039 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:25.250080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=54 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:25.256723 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:25.257177 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:25.258149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:25.258683 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:25.423794 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:25.433559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:25.435190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:25.436493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-26b006a4-ce39-4ed5-b8e5-734a10f78656 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.195007 May 26 13:49:25.437057 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 344/672] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:25 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:26.456426 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:26.457681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:26.465027 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:26.465478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:26.466252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:26.466762 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:26.610587 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:26.621224 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:26.623303 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:26.624691 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a59388d3-1e3c-405c-b55c-d0ddbf2e8a60 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.172521 May 26 13:49:26.626178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 329/673] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:26 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:27.643522 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:27.644341 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:27.650843 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:27.651292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:27.652658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:27.653140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:27.802787 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:27.811992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:27.813544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:27.814710 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8c77de6b-a7ba-4528-ba59-b84b6aff574f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.175306 May 26 13:49:27.815269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 345/674] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:27 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:28.834098 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:28.834704 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:28.841230 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:28.841683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:28.842442 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:28.842872 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:28.985108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:28.993662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:28.995179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:28.996392 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0e1c3e6e-f193-4fdb-a2ef-411c18537a79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.166170 May 26 13:49:28.996959 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 330/675] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:28 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:30.015300 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:30.015905 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:30.022575 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:30.023024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:30.023792 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:30.024230 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:30.160663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:30.171596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:30.173222 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:30.174320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c799f2dc-7323-461a-9492-ebbc947d13ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.162943 May 26 13:49:30.174919 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 346/676] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:30 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:31.198041 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:31.199267 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:31.206444 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:31.206888 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:31.207655 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:31.208276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:31.352125 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:31.361057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:31.362558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:31.363770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e6ccf82a-bca7-489d-82b1-30f35dbb7b4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.174022 May 26 13:49:31.364347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 331/677] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:31 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:32.388115 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:32.388809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:32.395687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:32.396147 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:32.397136 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:32.397571 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:32.543612 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:32.552115 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:32.553680 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:32.554870 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9efd750c-f75f-4cab-b276-e7c850765754 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.172194 May 26 13:49:32.555537 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 347/678] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:32 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:33.574155 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:33.574987 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:33.582415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:33.582865 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:33.583709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:33.584147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:33.587314 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:33.734162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:33.742629 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:33.744107 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:33.745684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc7e37e8-91d2-4a39-bc4a-3288375bd60a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.176122 May 26 13:49:33.746285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 332/679] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:33 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:49:34.765469 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:34.766854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:34.774497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:34.775419 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:34.776556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:34.777220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:34.919630 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:34.929242 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:34.930788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:34.932227 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a1d0c8f8-f8ca-45fc-af8d-46841891ae93 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.171606 May 26 13:49:34.933508 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 348/680] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:34 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:35.951975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:35.952635 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:35.959228 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:35.959666 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:35.960464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:35.960907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:36.095728 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:36.104079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:36.105847 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:36.106998 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0063762e-57a2-4bec-bf15-18055eb93ca3 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.159624 May 26 13:49:36.107563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 333/681] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:35 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:37.125580 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:37.126213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:37.132878 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:37.133357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:37.134104 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:37.136526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:37.270997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:37.280513 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:37.281987 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:37.283144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d7fe09ab-093f-4e2c-b88e-03197d262b49 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.161530 May 26 13:49:37.283696 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 349/682] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:37 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:38.302033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:38.302681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:38.309221 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:38.309668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:38.310434 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:38.310873 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:38.439368 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:38.448444 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:38.449965 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:38.451119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b6e2532f-9427-4873-93e5-7d6a6379a143 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.153075 May 26 13:49:38.451688 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 334/683] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:38 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:39.469468 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:39.470059 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:39.476649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:39.477098 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:39.477863 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:39.478367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:39.611872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:39.624096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:39.625639 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:39.626816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ec93515b-405d-46fc-83bb-e4406c4f0d40 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.161253 May 26 13:49:39.627378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 350/684] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:39 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:40.645644 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:40.646349 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:40.655121 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:40.655557 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:40.656353 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:40.656785 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:40.794342 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:40.802823 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:40.804331 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:40.805502 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e8737828-b94f-40cd-9f0f-0cf3d95bc123 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.164021 May 26 13:49:40.806055 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 335/685] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:40 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:41.824019 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:41.824661 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:41.831302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:41.831752 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:41.832543 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:41.832984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:41.835534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:42.022209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:42.030830 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:42.032359 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:42.033522 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8a0b748b-ec85-4d99-99da-cd7b2e0f536a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.214329 May 26 13:49:42.034087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 351/686] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:41 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:43.052859 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:43.053391 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:43.060528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:43.060970 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:43.061727 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:43.062154 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:43.241063 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:43.250153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:43.251640 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:43.252855 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2a487bcd-4af4-47d0-b87d-b068ebcaf3bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.204756 May 26 13:49:43.253411 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 336/687] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:43 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:44.377044 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:44.377645 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:44.383674 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:44.384119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:44.384918 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:44.385987 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:44.751294 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:44.759803 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:44.762436 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:44.763480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5ce4dcf3-e645-43a1-9a05-52cb7f7ea0f6 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.495826 May 26 13:49:44.764045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 352/688] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:44 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:45.308161 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:49:45.308806 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Thu May 26 13:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:49:45.781840 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:45.782449 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:45.789196 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:45.789640 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:45.790399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:45.790833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:45.930127 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:45.939816 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:45.941347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:45.942515 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-479a8fbe-6fd9-4b87-a263-437532081940 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.164575 May 26 13:49:45.943079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 337/689] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:45 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:46.961758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:46.962544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:46.969629 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:46.970072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:46.970827 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:46.971254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:47.099153 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:47.108110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:47.109654 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:47.111162 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f9eefde5-5a3d-4962-a82e-3c580ccfd89d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.153279 May 26 13:49:47.111735 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 353/690] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:46 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:48.129586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:48.130128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:48.132462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=28 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:48.138552 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:48.138974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:48.139735 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:48.140165 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:48.270596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:48.279382 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:48.280892 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:48.282035 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cd3d0bed-6c8f-4e72-8350-df96a601312a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.156457 May 26 13:49:48.282596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 338/691] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:48 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:49:49.301251 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:49.301874 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:49.307884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:49.308350 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:49.309106 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:49.309538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:49.443955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:49.453179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:49.454672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:49.455813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9e9ebe18-88ba-4cff-af4a-54bd298ae831 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.158661 May 26 13:49:49.456402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 354/692] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:49 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:50.475090 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:50.475708 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:50.483376 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:50.483828 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:50.484667 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:50.485104 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:50.620463 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:50.629049 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:50.630588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:50.631750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c4b7bd39-a5cf-46e9-96d8-64c3ac668606 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.160748 May 26 13:49:50.632330 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 339/693] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:50 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:51.653690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:51.654329 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:51.660863 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:51.661310 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:51.662088 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:51.662522 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:51.798213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:51.812020 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:51.813465 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:51.814623 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ce5200d3-549b-4b15-974b-fb64e6e5e0d0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.165920 May 26 13:49:51.815185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 355/694] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:51 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:49:52.834202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:52.834810 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:52.841498 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:52.841946 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:52.842714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:52.843151 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:52.977519 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:52.986555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:52.988057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:52.989528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-062afe22-dc1b-49d6-bcf3-ab521c260095 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.159230 May 26 13:49:52.990092 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 340/695] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:52 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:53.106588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-722201e2-bf01-4b97-bb0e-b98ea86dfbd9 req-dd475de1-784d-46f0-b318-29b162082bbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef326f08-0e4f-4ad0-9f62-f4197ccf5b65", "name": "network-vif-plugged", "status": "completed", "tag": "914816b6-d98c-46f8-9da7-123cb0956236"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:53.116077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-722201e2-bf01-4b97-bb0e-b98ea86dfbd9 req-dd475de1-784d-46f0-b318-29b162082bbf service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:53.116688 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-722201e2-bf01-4b97-bb0e-b98ea86dfbd9 req-dd475de1-784d-46f0-b318-29b162082bbf service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:53.130862 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-722201e2-bf01-4b97-bb0e-b98ea86dfbd9 req-dd475de1-784d-46f0-b318-29b162082bbf service nova] Creating event network-vif-plugged:914816b6-d98c-46f8-9da7-123cb0956236 for instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 on hv-cinder-81966 May 26 13:49:53.136702 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-722201e2-bf01-4b97-bb0e-b98ea86dfbd9 req-dd475de1-784d-46f0-b318-29b162082bbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034335 May 26 13:49:53.137345 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 356/696] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:49:54.008679 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:54.009319 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:54.015791 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:54.016244 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:54.017057 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:54.017494 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:54.147950 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:54.157146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:54.158659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:54.159825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-58b52244-98aa-4877-8e82-ff46df5dfdcd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.155061 May 26 13:49:54.160586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 341/697] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:54 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:54.161465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:49:54.161638 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Thu May 26 13:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:49:55.179704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:55.180326 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:55.187872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:55.188324 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:55.189104 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:55.189539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:55.321258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:55.330572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:55.332082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:55.333281 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c7746f29-c15f-41d4-90d4-bd3eca39b6cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1810 microversion: 2.20 time: 0.157943 May 26 13:49:55.333847 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 357/698] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:55 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:56.351832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:56.352518 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:56.359871 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:56.360330 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:56.361092 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:56.361525 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:56.489521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:56.498955 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:56.500482 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:56.501656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4399f494-cd0e-4ebe-8c1e-e8574c319fda tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1797 microversion: 2.20 time: 0.153794 May 26 13:49:56.502578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 342/699] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:49:56 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1797 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:49:59.303054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9b40da23-6d45-49c0-a133-fa4e5f37a247 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:49:59.304481 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9b40da23-6d45-49c0-a133-fa4e5f37a247 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:59.306575 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=28 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:49:59.312068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b40da23-6d45-49c0-a133-fa4e5f37a247 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:59.312536 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b40da23-6d45-49c0-a133-fa4e5f37a247 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:59.313299 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b40da23-6d45-49c0-a133-fa4e5f37a247 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:59.313729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9b40da23-6d45-49c0-a133-fa4e5f37a247 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:59.388952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9b40da23-6d45-49c0-a133-fa4e5f37a247 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "POST /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.089552 May 26 13:49:59.389581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 358/700] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:49:59 2022] POST /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:49:59.398370 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b46e7325-18ee-47c7-ae37-6ab7aea9afdd tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:49:59.399208 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b46e7325-18ee-47c7-ae37-6ab7aea9afdd tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:49:59.406755 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b46e7325-18ee-47c7-ae37-6ab7aea9afdd tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:59.407216 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b46e7325-18ee-47c7-ae37-6ab7aea9afdd tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:59.408164 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b46e7325-18ee-47c7-ae37-6ab7aea9afdd tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:49:59.408678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b46e7325-18ee-47c7-ae37-6ab7aea9afdd tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:49:59.603174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b46e7325-18ee-47c7-ae37-6ab7aea9afdd tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:49:59.612163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b46e7325-18ee-47c7-ae37-6ab7aea9afdd tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1750 microversion: 2.1 time: 0.218233 May 26 13:49:59.612774 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 343/701] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:49:59 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1750 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:00.631463 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-381d2cd7-6610-447e-ac47-8fe5aed85f65 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:00.632203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-381d2cd7-6610-447e-ac47-8fe5aed85f65 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:00.639212 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-381d2cd7-6610-447e-ac47-8fe5aed85f65 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:00.639762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-381d2cd7-6610-447e-ac47-8fe5aed85f65 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:00.640461 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-381d2cd7-6610-447e-ac47-8fe5aed85f65 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:00.640904 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-381d2cd7-6610-447e-ac47-8fe5aed85f65 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:00.785884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-381d2cd7-6610-447e-ac47-8fe5aed85f65 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:00.794540 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-381d2cd7-6610-447e-ac47-8fe5aed85f65 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.167792 May 26 13:50:00.795119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 359/702] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:00 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:01.811588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-23051a5c-ba1d-482e-a04a-5170b3461aee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:01.812187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-23051a5c-ba1d-482e-a04a-5170b3461aee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:01.818668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23051a5c-ba1d-482e-a04a-5170b3461aee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:01.819114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23051a5c-ba1d-482e-a04a-5170b3461aee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:01.820127 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23051a5c-ba1d-482e-a04a-5170b3461aee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:01.820589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-23051a5c-ba1d-482e-a04a-5170b3461aee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:01.972665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-23051a5c-ba1d-482e-a04a-5170b3461aee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:01.981374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-23051a5c-ba1d-482e-a04a-5170b3461aee tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.173558 May 26 13:50:01.982288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 344/703] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:01 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:02.998298 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b287bca9-fb6e-4f77-b673-43834aa93e14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:02.998984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b287bca9-fb6e-4f77-b673-43834aa93e14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:03.005735 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b287bca9-fb6e-4f77-b673-43834aa93e14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:03.006183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b287bca9-fb6e-4f77-b673-43834aa93e14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:03.006956 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b287bca9-fb6e-4f77-b673-43834aa93e14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:03.007394 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b287bca9-fb6e-4f77-b673-43834aa93e14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:03.150826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b287bca9-fb6e-4f77-b673-43834aa93e14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:03.159250 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b287bca9-fb6e-4f77-b673-43834aa93e14 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.164765 May 26 13:50:03.159824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 360/704] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:02 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:04.177473 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fb49a104-0a81-406e-ab0e-8f2e6bf631f9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:04.178052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fb49a104-0a81-406e-ab0e-8f2e6bf631f9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:04.184690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb49a104-0a81-406e-ab0e-8f2e6bf631f9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:04.185142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb49a104-0a81-406e-ab0e-8f2e6bf631f9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:04.185902 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb49a104-0a81-406e-ab0e-8f2e6bf631f9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:04.186418 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb49a104-0a81-406e-ab0e-8f2e6bf631f9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:04.188877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=78 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:50:04.343867 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fb49a104-0a81-406e-ab0e-8f2e6bf631f9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:04.351927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fb49a104-0a81-406e-ab0e-8f2e6bf631f9 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.178389 May 26 13:50:04.352525 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 345/705] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:04 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:50:05.372761 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9cb4a1d2-72b1-4193-a19e-1ad0d794979e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:05.373481 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9cb4a1d2-72b1-4193-a19e-1ad0d794979e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:05.379768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9cb4a1d2-72b1-4193-a19e-1ad0d794979e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:05.380208 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9cb4a1d2-72b1-4193-a19e-1ad0d794979e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:05.380998 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9cb4a1d2-72b1-4193-a19e-1ad0d794979e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:05.381428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9cb4a1d2-72b1-4193-a19e-1ad0d794979e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:05.526603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9cb4a1d2-72b1-4193-a19e-1ad0d794979e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:05.534538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9cb4a1d2-72b1-4193-a19e-1ad0d794979e tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.166256 May 26 13:50:05.535101 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 361/706] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:05 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:06.550932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-90b6f403-8ab6-42f8-9a0a-100117ddfeda tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:06.551528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-90b6f403-8ab6-42f8-9a0a-100117ddfeda tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:06.558909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90b6f403-8ab6-42f8-9a0a-100117ddfeda tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:06.559346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90b6f403-8ab6-42f8-9a0a-100117ddfeda tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:06.560098 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90b6f403-8ab6-42f8-9a0a-100117ddfeda tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:06.560555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-90b6f403-8ab6-42f8-9a0a-100117ddfeda tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:06.704168 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-90b6f403-8ab6-42f8-9a0a-100117ddfeda tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:06.712762 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-90b6f403-8ab6-42f8-9a0a-100117ddfeda tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.165084 May 26 13:50:06.713713 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 346/707] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:06 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:07.731002 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-15dddc7f-b6f1-476a-86af-4480cdc97cec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:07.731614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-15dddc7f-b6f1-476a-86af-4480cdc97cec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:07.738124 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15dddc7f-b6f1-476a-86af-4480cdc97cec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:07.738578 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15dddc7f-b6f1-476a-86af-4480cdc97cec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:07.739416 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15dddc7f-b6f1-476a-86af-4480cdc97cec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:07.739920 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15dddc7f-b6f1-476a-86af-4480cdc97cec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:07.882288 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-15dddc7f-b6f1-476a-86af-4480cdc97cec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:07.890903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-15dddc7f-b6f1-476a-86af-4480cdc97cec tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.164445 May 26 13:50:07.891461 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 362/708] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:07 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:08.908666 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-566c8517-8536-4909-b9f4-b8288c6d8301 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:08.909301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-566c8517-8536-4909-b9f4-b8288c6d8301 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:08.916526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-566c8517-8536-4909-b9f4-b8288c6d8301 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:08.916977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-566c8517-8536-4909-b9f4-b8288c6d8301 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:08.917753 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-566c8517-8536-4909-b9f4-b8288c6d8301 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:08.918188 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-566c8517-8536-4909-b9f4-b8288c6d8301 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:09.059726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-566c8517-8536-4909-b9f4-b8288c6d8301 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:09.067601 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-566c8517-8536-4909-b9f4-b8288c6d8301 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.162877 May 26 13:50:09.068171 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 347/709] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:08 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:10.140620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8d210453-ca78-428b-b51a-84cbfb93374b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:10.141204 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8d210453-ca78-428b-b51a-84cbfb93374b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:10.147640 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d210453-ca78-428b-b51a-84cbfb93374b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:10.148077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d210453-ca78-428b-b51a-84cbfb93374b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:10.148863 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d210453-ca78-428b-b51a-84cbfb93374b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:10.149288 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d210453-ca78-428b-b51a-84cbfb93374b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:10.296825 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8d210453-ca78-428b-b51a-84cbfb93374b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:10.304840 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8d210453-ca78-428b-b51a-84cbfb93374b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.168178 May 26 13:50:10.305410 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 363/710] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:10 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:10.509968 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6ef877da-4a19-4298-9547-35bc2c171a67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13fcc238-c5ac-448e-acdc-fe75336fffeb"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:50:10.511119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6ef877da-4a19-4298-9547-35bc2c171a67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:10.517169 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ef877da-4a19-4298-9547-35bc2c171a67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:10.517617 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ef877da-4a19-4298-9547-35bc2c171a67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:10.518388 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ef877da-4a19-4298-9547-35bc2c171a67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:10.518824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6ef877da-4a19-4298-9547-35bc2c171a67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:10.798809 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6ef877da-4a19-4298-9547-35bc2c171a67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402095 May 26 13:50:10.799433 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 348/711] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:50:10 2022] POST /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:50:11.323113 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1315445c-7383-4ff3-925b-634f7bb2dab4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:11.323752 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1315445c-7383-4ff3-925b-634f7bb2dab4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:11.330707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1315445c-7383-4ff3-925b-634f7bb2dab4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:11.331159 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1315445c-7383-4ff3-925b-634f7bb2dab4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:11.331939 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1315445c-7383-4ff3-925b-634f7bb2dab4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:11.332421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1315445c-7383-4ff3-925b-634f7bb2dab4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:11.477473 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1315445c-7383-4ff3-925b-634f7bb2dab4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:11.498739 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1315445c-7383-4ff3-925b-634f7bb2dab4 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1755 microversion: 2.1 time: 0.179682 May 26 13:50:11.499438 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 364/712] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:11 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:12.516778 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c9b8a80-4668-4d15-89cb-7a8ab00f66e2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:12.517469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c9b8a80-4668-4d15-89cb-7a8ab00f66e2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:12.524200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c9b8a80-4668-4d15-89cb-7a8ab00f66e2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:12.525342 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c9b8a80-4668-4d15-89cb-7a8ab00f66e2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:12.526098 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c9b8a80-4668-4d15-89cb-7a8ab00f66e2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:12.526527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c9b8a80-4668-4d15-89cb-7a8ab00f66e2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:12.674119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c9b8a80-4668-4d15-89cb-7a8ab00f66e2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:12.683033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c9b8a80-4668-4d15-89cb-7a8ab00f66e2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1758 microversion: 2.1 time: 0.170421 May 26 13:50:12.683593 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 349/713] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:12 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:18.299389 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-407f56b2-bffb-47ca-81b7-ef84a497e0d2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:50:18.300421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-407f56b2-bffb-47ca-81b7-ef84a497e0d2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:18.307145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-407f56b2-bffb-47ca-81b7-ef84a497e0d2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:18.307594 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-407f56b2-bffb-47ca-81b7-ef84a497e0d2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:18.308379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-407f56b2-bffb-47ca-81b7-ef84a497e0d2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:18.308838 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-407f56b2-bffb-47ca-81b7-ef84a497e0d2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:18.311286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:50:18.334952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-407f56b2-bffb-47ca-81b7-ef84a497e0d2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lazy-loading 'flavor' on Instance uuid eda2ad3f-020c-4f84-8456-bd57ac8994a1 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:50:18.467775 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-407f56b2-bffb-47ca-81b7-ef84a497e0d2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/action" status: 200 len: 32 microversion: 2.1 time: 0.172108 May 26 13:50:18.468614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 365/714] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:50:18 2022] POST /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:50:18.477873 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a0d12c8c-07c2-42dc-b1f2-2661dc8dc1fa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:18.478485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a0d12c8c-07c2-42dc-b1f2-2661dc8dc1fa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:18.481069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=24 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:50:18.486335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0d12c8c-07c2-42dc-b1f2-2661dc8dc1fa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:18.486789 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0d12c8c-07c2-42dc-b1f2-2661dc8dc1fa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:18.487566 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0d12c8c-07c2-42dc-b1f2-2661dc8dc1fa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:18.488011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a0d12c8c-07c2-42dc-b1f2-2661dc8dc1fa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:18.710144 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a0d12c8c-07c2-42dc-b1f2-2661dc8dc1fa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:18.718474 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a0d12c8c-07c2-42dc-b1f2-2661dc8dc1fa tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.244542 May 26 13:50:18.719051 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 350/715] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:18 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:19.736221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-91298ed9-5be2-475f-a65d-9c4b1090a745 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:19.736934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-91298ed9-5be2-475f-a65d-9c4b1090a745 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:19.743233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91298ed9-5be2-475f-a65d-9c4b1090a745 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:19.744012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91298ed9-5be2-475f-a65d-9c4b1090a745 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:19.745442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91298ed9-5be2-475f-a65d-9c4b1090a745 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:19.745954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91298ed9-5be2-475f-a65d-9c4b1090a745 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:19.884090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-91298ed9-5be2-475f-a65d-9c4b1090a745 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:19.891999 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-91298ed9-5be2-475f-a65d-9c4b1090a745 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.160480 May 26 13:50:19.892585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 366/716] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:19 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:20.910103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-518e2194-3f07-454d-b503-809bd7fb0806 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:20.910825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-518e2194-3f07-454d-b503-809bd7fb0806 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:20.917924 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-518e2194-3f07-454d-b503-809bd7fb0806 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:20.918376 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-518e2194-3f07-454d-b503-809bd7fb0806 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:20.919152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-518e2194-3f07-454d-b503-809bd7fb0806 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:20.919969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-518e2194-3f07-454d-b503-809bd7fb0806 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:21.047996 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-518e2194-3f07-454d-b503-809bd7fb0806 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:21.056966 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-518e2194-3f07-454d-b503-809bd7fb0806 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.150690 May 26 13:50:21.057538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 351/717] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:20 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:22.074266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6682d42f-50f7-4575-a60d-dffea95715c7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:22.074874 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6682d42f-50f7-4575-a60d-dffea95715c7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:22.086568 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6682d42f-50f7-4575-a60d-dffea95715c7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:22.087027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6682d42f-50f7-4575-a60d-dffea95715c7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:22.087800 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6682d42f-50f7-4575-a60d-dffea95715c7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:22.088240 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6682d42f-50f7-4575-a60d-dffea95715c7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:22.215970 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6682d42f-50f7-4575-a60d-dffea95715c7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:22.224033 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6682d42f-50f7-4575-a60d-dffea95715c7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.153692 May 26 13:50:22.224633 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 367/718] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:22 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:23.241470 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b145f066-73a8-4ac4-9210-2ea0e53e7f7d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:23.242079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b145f066-73a8-4ac4-9210-2ea0e53e7f7d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:23.249627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b145f066-73a8-4ac4-9210-2ea0e53e7f7d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:23.250102 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b145f066-73a8-4ac4-9210-2ea0e53e7f7d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:23.250939 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b145f066-73a8-4ac4-9210-2ea0e53e7f7d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:23.251396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b145f066-73a8-4ac4-9210-2ea0e53e7f7d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:23.392266 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b145f066-73a8-4ac4-9210-2ea0e53e7f7d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:23.401907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b145f066-73a8-4ac4-9210-2ea0e53e7f7d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.164194 May 26 13:50:23.402554 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 352/719] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:23 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:23.923231 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-62e848f8-8756-4fcb-b8f3-9826b8934420 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:23.923728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-62e848f8-8756-4fcb-b8f3-9826b8934420 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:23.930125 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-62e848f8-8756-4fcb-b8f3-9826b8934420 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:23.930572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-62e848f8-8756-4fcb-b8f3-9826b8934420 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:23.931520 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-62e848f8-8756-4fcb-b8f3-9826b8934420 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:23.931957 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-62e848f8-8756-4fcb-b8f3-9826b8934420 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:24.063406 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-62e848f8-8756-4fcb-b8f3-9826b8934420 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lazy-loading 'services' on Instance uuid 84b45620-7dd5-4bb5-9da2-e48381d78256 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:50:24.179599 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-62e848f8-8756-4fcb-b8f3-9826b8934420 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/os-volume_attachments/26b3a9bd-b195-4cd8-ac58-015925d22187" status: 202 len: 0 microversion: 2.1 time: 0.366611 May 26 13:50:24.180598 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 368/720] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 13:50:23 2022] DELETE /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/os-volume_attachments/26b3a9bd-b195-4cd8-ac58-015925d22187 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:50:24.419187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e7506933-e6d6-4fd4-b3d4-2ce46d65291d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:24.419725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e7506933-e6d6-4fd4-b3d4-2ce46d65291d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:24.426273 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7506933-e6d6-4fd4-b3d4-2ce46d65291d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:24.426737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7506933-e6d6-4fd4-b3d4-2ce46d65291d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:24.427480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7506933-e6d6-4fd4-b3d4-2ce46d65291d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:24.427915 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e7506933-e6d6-4fd4-b3d4-2ce46d65291d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:24.563676 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e7506933-e6d6-4fd4-b3d4-2ce46d65291d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:24.572322 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e7506933-e6d6-4fd4-b3d4-2ce46d65291d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.157043 May 26 13:50:24.572897 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 353/721] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:24 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:25.301967 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c840dfb9-6544-4dfa-bf1e-7d0cbf56c168 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:50:25.309635 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c840dfb9-6544-4dfa-bf1e-7d0cbf56c168 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:25.310094 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c840dfb9-6544-4dfa-bf1e-7d0cbf56c168 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:25.332057 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c840dfb9-6544-4dfa-bf1e-7d0cbf56c168 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Going to try to stop instance {{(pid=124240) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 13:50:25.377866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c840dfb9-6544-4dfa-bf1e-7d0cbf56c168 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/action" status: 202 len: 0 microversion: 2.1 time: 0.081593 May 26 13:50:25.378478 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 369/722] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:50:25 2022] POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:50:25.386481 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1a3147c6-51ec-4336-b219-aabd8ff6309e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:25.387086 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1a3147c6-51ec-4336-b219-aabd8ff6309e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:25.394039 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a3147c6-51ec-4336-b219-aabd8ff6309e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:25.394502 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a3147c6-51ec-4336-b219-aabd8ff6309e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:25.395332 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a3147c6-51ec-4336-b219-aabd8ff6309e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:25.395982 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1a3147c6-51ec-4336-b219-aabd8ff6309e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:25.532727 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1a3147c6-51ec-4336-b219-aabd8ff6309e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:25.541016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1a3147c6-51ec-4336-b219-aabd8ff6309e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.158195 May 26 13:50:25.541598 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 354/723] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:25 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:25.590495 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d2833dd9-08bf-49c2-b199-3d50df4f32d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:25.591113 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d2833dd9-08bf-49c2-b199-3d50df4f32d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:25.597335 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d2833dd9-08bf-49c2-b199-3d50df4f32d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:25.597786 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d2833dd9-08bf-49c2-b199-3d50df4f32d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:25.598551 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d2833dd9-08bf-49c2-b199-3d50df4f32d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:25.599015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d2833dd9-08bf-49c2-b199-3d50df4f32d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:25.731432 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d2833dd9-08bf-49c2-b199-3d50df4f32d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:25.739748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d2833dd9-08bf-49c2-b199-3d50df4f32d7 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.154048 May 26 13:50:25.740266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 370/724] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:25 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:26.560495 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0292d7c3-e02a-48a1-b713-9e1a98c2745e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:26.561303 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0292d7c3-e02a-48a1-b713-9e1a98c2745e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:26.567868 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0292d7c3-e02a-48a1-b713-9e1a98c2745e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:26.568402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0292d7c3-e02a-48a1-b713-9e1a98c2745e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:26.569425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0292d7c3-e02a-48a1-b713-9e1a98c2745e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:26.569860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0292d7c3-e02a-48a1-b713-9e1a98c2745e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:26.719873 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0292d7c3-e02a-48a1-b713-9e1a98c2745e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:26.731561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0292d7c3-e02a-48a1-b713-9e1a98c2745e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.177312 May 26 13:50:26.732435 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 355/725] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:26 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:50:26.756966 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-46ce286c-c59c-4ad5-a986-bc05765726f2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:26.758048 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-46ce286c-c59c-4ad5-a986-bc05765726f2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:26.765619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-46ce286c-c59c-4ad5-a986-bc05765726f2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:26.766069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-46ce286c-c59c-4ad5-a986-bc05765726f2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:26.766865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-46ce286c-c59c-4ad5-a986-bc05765726f2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:26.767297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-46ce286c-c59c-4ad5-a986-bc05765726f2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:26.907245 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-46ce286c-c59c-4ad5-a986-bc05765726f2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:26.916225 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-46ce286c-c59c-4ad5-a986-bc05765726f2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.163190 May 26 13:50:26.917038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 371/726] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:26 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:27.749419 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e548e7cd-b022-4b2f-a311-10ec4934d65b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:27.750007 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e548e7cd-b022-4b2f-a311-10ec4934d65b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:27.756556 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e548e7cd-b022-4b2f-a311-10ec4934d65b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:27.757003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e548e7cd-b022-4b2f-a311-10ec4934d65b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:27.757772 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e548e7cd-b022-4b2f-a311-10ec4934d65b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:27.759033 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e548e7cd-b022-4b2f-a311-10ec4934d65b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:27.902627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e548e7cd-b022-4b2f-a311-10ec4934d65b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:27.910065 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e548e7cd-b022-4b2f-a311-10ec4934d65b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.164491 May 26 13:50:27.910622 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 356/727] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:27 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:27.934316 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e0580a64-b155-4d08-9597-53df923e79ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:27.934918 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e0580a64-b155-4d08-9597-53df923e79ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:27.941271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0580a64-b155-4d08-9597-53df923e79ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:27.941707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0580a64-b155-4d08-9597-53df923e79ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:27.942450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0580a64-b155-4d08-9597-53df923e79ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:27.942876 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0580a64-b155-4d08-9597-53df923e79ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:28.227968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e0580a64-b155-4d08-9597-53df923e79ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:28.236069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e0580a64-b155-4d08-9597-53df923e79ee tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.306663 May 26 13:50:28.236683 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 372/728] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:27 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:28.927070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-be981882-c9d1-44ea-83fd-f08d9b061436 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:28.927721 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-be981882-c9d1-44ea-83fd-f08d9b061436 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:28.934387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be981882-c9d1-44ea-83fd-f08d9b061436 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:28.934830 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be981882-c9d1-44ea-83fd-f08d9b061436 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:28.935581 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be981882-c9d1-44ea-83fd-f08d9b061436 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:28.936007 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-be981882-c9d1-44ea-83fd-f08d9b061436 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:29.062348 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-be981882-c9d1-44ea-83fd-f08d9b061436 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:29.070131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-be981882-c9d1-44ea-83fd-f08d9b061436 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.146943 May 26 13:50:29.071327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 357/729] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:28 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:29.253758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-80e87ab0-ee11-4bda-ba07-ce5fa4475d4d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:29.254356 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-80e87ab0-ee11-4bda-ba07-ce5fa4475d4d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:29.261578 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-80e87ab0-ee11-4bda-ba07-ce5fa4475d4d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:29.262011 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-80e87ab0-ee11-4bda-ba07-ce5fa4475d4d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:29.262760 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-80e87ab0-ee11-4bda-ba07-ce5fa4475d4d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:29.263187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-80e87ab0-ee11-4bda-ba07-ce5fa4475d4d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:29.398833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-80e87ab0-ee11-4bda-ba07-ce5fa4475d4d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:29.406868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-80e87ab0-ee11-4bda-ba07-ce5fa4475d4d tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.156930 May 26 13:50:29.407415 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 373/730] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:29 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:30.088066 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ce9cb0f5-0b55-4adc-953f-c1baac2c437d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:30.088701 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ce9cb0f5-0b55-4adc-953f-c1baac2c437d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:30.095193 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce9cb0f5-0b55-4adc-953f-c1baac2c437d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:30.095646 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce9cb0f5-0b55-4adc-953f-c1baac2c437d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:30.096442 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce9cb0f5-0b55-4adc-953f-c1baac2c437d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:30.096883 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce9cb0f5-0b55-4adc-953f-c1baac2c437d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:30.223943 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ce9cb0f5-0b55-4adc-953f-c1baac2c437d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:30.232569 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ce9cb0f5-0b55-4adc-953f-c1baac2c437d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.148795 May 26 13:50:30.233134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 358/731] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:30 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:30.423704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-688ac341-35f4-4aff-958f-3f8f52d39f3e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:30.424255 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-688ac341-35f4-4aff-958f-3f8f52d39f3e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:30.426693 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=32 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:50:30.432243 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-688ac341-35f4-4aff-958f-3f8f52d39f3e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:30.432725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-688ac341-35f4-4aff-958f-3f8f52d39f3e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:30.433494 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-688ac341-35f4-4aff-958f-3f8f52d39f3e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:30.433952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-688ac341-35f4-4aff-958f-3f8f52d39f3e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:30.564479 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-688ac341-35f4-4aff-958f-3f8f52d39f3e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:30.574058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-688ac341-35f4-4aff-958f-3f8f52d39f3e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.154484 May 26 13:50:30.575011 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 374/732] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:30 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:31.249651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7dba3522-5d75-45c6-bdb0-607793185c78 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:31.250253 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7dba3522-5d75-45c6-bdb0-607793185c78 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:31.256949 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dba3522-5d75-45c6-bdb0-607793185c78 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:31.257399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dba3522-5d75-45c6-bdb0-607793185c78 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:31.258177 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dba3522-5d75-45c6-bdb0-607793185c78 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:31.258661 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7dba3522-5d75-45c6-bdb0-607793185c78 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:31.411427 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7dba3522-5d75-45c6-bdb0-607793185c78 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:31.419816 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7dba3522-5d75-45c6-bdb0-607793185c78 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.174080 May 26 13:50:31.420400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 359/733] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:31 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:31.591475 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ecc6cc37-f790-42e1-9d86-4c00de15da6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:31.592032 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ecc6cc37-f790-42e1-9d86-4c00de15da6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:31.598492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ecc6cc37-f790-42e1-9d86-4c00de15da6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:31.598936 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ecc6cc37-f790-42e1-9d86-4c00de15da6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:31.599696 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ecc6cc37-f790-42e1-9d86-4c00de15da6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:31.600218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ecc6cc37-f790-42e1-9d86-4c00de15da6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:31.734570 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ecc6cc37-f790-42e1-9d86-4c00de15da6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:31.742756 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ecc6cc37-f790-42e1-9d86-4c00de15da6c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1734 microversion: 2.1 time: 0.155018 May 26 13:50:31.743328 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 375/734] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:31 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:32.436716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-af267062-d95c-4d60-9ce6-1068f85bce20 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:32.437321 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-af267062-d95c-4d60-9ce6-1068f85bce20 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:32.443705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af267062-d95c-4d60-9ce6-1068f85bce20 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:32.444448 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af267062-d95c-4d60-9ce6-1068f85bce20 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:32.445207 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af267062-d95c-4d60-9ce6-1068f85bce20 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:32.445641 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-af267062-d95c-4d60-9ce6-1068f85bce20 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:32.462619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:50:32.580803 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-af267062-d95c-4d60-9ce6-1068f85bce20 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:32.590126 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-af267062-d95c-4d60-9ce6-1068f85bce20 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.157176 May 26 13:50:32.590697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 360/735] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:32 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:32.760671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d89ba5c3-1a41-4edf-8d0a-5969beecca36 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:32.761211 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d89ba5c3-1a41-4edf-8d0a-5969beecca36 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:32.767633 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d89ba5c3-1a41-4edf-8d0a-5969beecca36 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:32.768080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d89ba5c3-1a41-4edf-8d0a-5969beecca36 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:32.768881 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d89ba5c3-1a41-4edf-8d0a-5969beecca36 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:32.769317 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d89ba5c3-1a41-4edf-8d0a-5969beecca36 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:32.901917 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d89ba5c3-1a41-4edf-8d0a-5969beecca36 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:32.910463 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d89ba5c3-1a41-4edf-8d0a-5969beecca36 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1714 microversion: 2.1 time: 0.154647 May 26 13:50:32.911036 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 376/736] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:32 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:32.966776 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:32.967262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:32.973250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:32.973701 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:32.974462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:32.974900 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:33.097018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] HTTP exception thrown: Cannot 'detach_volume' instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 while it is in vm_state rescued May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Request method failure captured: May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments/13fcc238-c5ac-448e-acdc-fe75336fffeb HTTP/1.1 May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RbRUWuARFGkE_5vp-aUVCmAd1sOs3n7Bajq1lOXpZEUZd0FBaykhrcUrub2qPRQYXLnHjACEWP4w_Z4B9q9yTmJ2gk5KWB4cACUVTYnFQTvxh3ybkOd-tbUcxA__Sdrz4Pf61dXEV6D8lKHhkmLUd_V7SNHeFyJJ5tDhiruopzKPU May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:50:33.098606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_667a2ccd9c9045879b4b87e156997161", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: dd8055e46e6149d3897fb88af0b19d39 May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:50:33.100175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Cannot 'detach_volume' instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 while it is in vm_state rescued May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'server_id': 'eda2ad3f-020c-4f84-8456-bd57ac8994a1', 'id': '13fcc238-c5ac-448e-acdc-fe75336fffeb'} May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:50:33.101053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 while it is in vm_state rescued May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 while it is in vm_state rescued May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:50:33.102281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Returning 409 to user: Cannot 'detach_volume' instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 while it is in vm_state rescued {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:50:33.103345 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-853f9c29-995b-4e91-9f91-6399fa49d059 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments/13fcc238-c5ac-448e-acdc-fe75336fffeb" status: 409 len: 152 microversion: 2.1 time: 0.137317 May 26 13:50:33.103345 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 361/737] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 13:50:32 2022] DELETE /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments/13fcc238-c5ac-448e-acdc-fe75336fffeb => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 13:50:33.109658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a4fdff08-79c7-45cd-966a-1457e4e96467 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:50:33.110651 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a4fdff08-79c7-45cd-966a-1457e4e96467 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:33.117614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a4fdff08-79c7-45cd-966a-1457e4e96467 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:33.118129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a4fdff08-79c7-45cd-966a-1457e4e96467 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:33.118982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a4fdff08-79c7-45cd-966a-1457e4e96467 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:33.119451 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a4fdff08-79c7-45cd-966a-1457e4e96467 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:33.157379 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:50:33.187369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a4fdff08-79c7-45cd-966a-1457e4e96467 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "POST /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/action" status: 202 len: 0 microversion: 2.1 time: 0.081864 May 26 13:50:33.188009 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 377/738] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:50:33 2022] POST /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:50:33.197024 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e4c94e4e-d86d-41e9-8328-21a7ea56ccc2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:33.197625 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e4c94e4e-d86d-41e9-8328-21a7ea56ccc2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:33.204599 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4c94e4e-d86d-41e9-8328-21a7ea56ccc2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:33.205047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4c94e4e-d86d-41e9-8328-21a7ea56ccc2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:33.205818 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4c94e4e-d86d-41e9-8328-21a7ea56ccc2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:33.206257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e4c94e4e-d86d-41e9-8328-21a7ea56ccc2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:33.610025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-06b827c6-fc11-4100-8239-b9e15a24bc1b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:33.611040 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-06b827c6-fc11-4100-8239-b9e15a24bc1b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:33.619836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-06b827c6-fc11-4100-8239-b9e15a24bc1b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:33.620419 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-06b827c6-fc11-4100-8239-b9e15a24bc1b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:33.621597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-06b827c6-fc11-4100-8239-b9e15a24bc1b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:33.622371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-06b827c6-fc11-4100-8239-b9e15a24bc1b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:33.636803 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e4c94e4e-d86d-41e9-8328-21a7ea56ccc2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:33.646306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e4c94e4e-d86d-41e9-8328-21a7ea56ccc2 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1722 microversion: 2.1 time: 0.453949 May 26 13:50:33.646873 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 362/739] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:33 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:33.767313 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-06b827c6-fc11-4100-8239-b9e15a24bc1b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:33.775962 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-06b827c6-fc11-4100-8239-b9e15a24bc1b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.171052 May 26 13:50:33.776637 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 378/740] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:33 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:50:34.664875 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-54de2548-eb24-478f-b7b0-62f69888bea4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:34.665480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-54de2548-eb24-478f-b7b0-62f69888bea4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:34.672765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54de2548-eb24-478f-b7b0-62f69888bea4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:34.673212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54de2548-eb24-478f-b7b0-62f69888bea4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:34.673987 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54de2548-eb24-478f-b7b0-62f69888bea4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:34.674419 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-54de2548-eb24-478f-b7b0-62f69888bea4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:34.794932 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-25c4b7fe-4b7d-461f-8d46-394f42f4a382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:34.795539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-25c4b7fe-4b7d-461f-8d46-394f42f4a382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:34.801992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-25c4b7fe-4b7d-461f-8d46-394f42f4a382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:34.802433 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-25c4b7fe-4b7d-461f-8d46-394f42f4a382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:34.803192 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-25c4b7fe-4b7d-461f-8d46-394f42f4a382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:34.803620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-25c4b7fe-4b7d-461f-8d46-394f42f4a382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:34.810795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-54de2548-eb24-478f-b7b0-62f69888bea4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:34.818874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-54de2548-eb24-478f-b7b0-62f69888bea4 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1722 microversion: 2.1 time: 0.157859 May 26 13:50:34.819710 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 363/741] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:34 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:34.951044 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-25c4b7fe-4b7d-461f-8d46-394f42f4a382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:34.959033 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-25c4b7fe-4b7d-461f-8d46-394f42f4a382 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.168130 May 26 13:50:34.959618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 379/742] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:34 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:35.836958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1b2e0678-e820-4f9e-97cd-de52fa7dff54 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:35.837558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1b2e0678-e820-4f9e-97cd-de52fa7dff54 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:35.844195 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b2e0678-e820-4f9e-97cd-de52fa7dff54 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:35.844745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b2e0678-e820-4f9e-97cd-de52fa7dff54 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:35.845454 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b2e0678-e820-4f9e-97cd-de52fa7dff54 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:35.845917 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b2e0678-e820-4f9e-97cd-de52fa7dff54 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:35.977362 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c0a62cf2-7cac-481a-bd40-8724e515251e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:35.977953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c0a62cf2-7cac-481a-bd40-8724e515251e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:35.984818 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0a62cf2-7cac-481a-bd40-8724e515251e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:35.985289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0a62cf2-7cac-481a-bd40-8724e515251e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:35.986058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0a62cf2-7cac-481a-bd40-8724e515251e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:35.986493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0a62cf2-7cac-481a-bd40-8724e515251e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:35.987602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1b2e0678-e820-4f9e-97cd-de52fa7dff54 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:35.996219 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1b2e0678-e820-4f9e-97cd-de52fa7dff54 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1722 microversion: 2.1 time: 0.163249 May 26 13:50:35.996820 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 364/743] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:35 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:36.137272 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c0a62cf2-7cac-481a-bd40-8724e515251e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:36.144898 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c0a62cf2-7cac-481a-bd40-8724e515251e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.172420 May 26 13:50:36.145544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 380/744] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:35 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:50:37.014612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bfc20923-9674-4022-8b47-9e0511a36d8c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:37.015510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bfc20923-9674-4022-8b47-9e0511a36d8c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:37.022346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bfc20923-9674-4022-8b47-9e0511a36d8c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:37.022804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bfc20923-9674-4022-8b47-9e0511a36d8c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:37.023921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bfc20923-9674-4022-8b47-9e0511a36d8c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:37.024464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bfc20923-9674-4022-8b47-9e0511a36d8c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:37.159725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bfc20923-9674-4022-8b47-9e0511a36d8c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:37.165353 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-07143ea0-4ed6-4934-a730-eba1fcc08557 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:37.166043 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-07143ea0-4ed6-4934-a730-eba1fcc08557 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:37.168351 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bfc20923-9674-4022-8b47-9e0511a36d8c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1722 microversion: 2.1 time: 0.157688 May 26 13:50:37.168919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 365/745] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:37 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:37.172888 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-07143ea0-4ed6-4934-a730-eba1fcc08557 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:37.173320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-07143ea0-4ed6-4934-a730-eba1fcc08557 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:37.174087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-07143ea0-4ed6-4934-a730-eba1fcc08557 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:37.174519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-07143ea0-4ed6-4934-a730-eba1fcc08557 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:37.316810 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-07143ea0-4ed6-4934-a730-eba1fcc08557 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:37.324731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-07143ea0-4ed6-4934-a730-eba1fcc08557 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.163858 May 26 13:50:37.325307 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 381/746] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:37 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:50:38.186105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fb892e8f-cbae-45fa-b9eb-199071b99c1b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:38.186692 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fb892e8f-cbae-45fa-b9eb-199071b99c1b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:38.197126 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb892e8f-cbae-45fa-b9eb-199071b99c1b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:38.197795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb892e8f-cbae-45fa-b9eb-199071b99c1b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:38.198596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb892e8f-cbae-45fa-b9eb-199071b99c1b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:38.199163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb892e8f-cbae-45fa-b9eb-199071b99c1b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:38.333257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fb892e8f-cbae-45fa-b9eb-199071b99c1b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:38.342006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fb892e8f-cbae-45fa-b9eb-199071b99c1b tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1728 microversion: 2.1 time: 0.159745 May 26 13:50:38.342199 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d686f369-cddc-48f1-8668-af1555eb8d64 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:38.342644 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 366/747] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:38 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:38.342741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d686f369-cddc-48f1-8668-af1555eb8d64 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:38.348997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d686f369-cddc-48f1-8668-af1555eb8d64 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:38.349440 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d686f369-cddc-48f1-8668-af1555eb8d64 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:38.350196 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d686f369-cddc-48f1-8668-af1555eb8d64 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:38.350622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d686f369-cddc-48f1-8668-af1555eb8d64 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:38.359011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5dd3a18a-8931-47b6-bc56-e0ea98c4013e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:38.359543 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5dd3a18a-8931-47b6-bc56-e0ea98c4013e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:38.365682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5dd3a18a-8931-47b6-bc56-e0ea98c4013e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:38.366127 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5dd3a18a-8931-47b6-bc56-e0ea98c4013e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:38.366958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5dd3a18a-8931-47b6-bc56-e0ea98c4013e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:38.367389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5dd3a18a-8931-47b6-bc56-e0ea98c4013e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:38.444389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5dd3a18a-8931-47b6-bc56-e0ea98c4013e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088971 May 26 13:50:38.445152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 367/748] 10.222.0.16 () {58 vars in 1274 bytes} [Thu May 26 13:50:38 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:50:38.481883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d686f369-cddc-48f1-8668-af1555eb8d64 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:38.489623 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d686f369-cddc-48f1-8668-af1555eb8d64 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.151241 May 26 13:50:38.490202 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 382/749] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:38 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:50:39.493432 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-7c7a7b80-8ccd-4d8f-8355-b973eebab93b req-e03dfd2d-441f-4717-94df-15e36fcfbdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda2ad3f-020c-4f84-8456-bd57ac8994a1", "tag": "8a479ff1-a45a-48a2-afb3-db2272655b74"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:50:39.501775 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-7c7a7b80-8ccd-4d8f-8355-b973eebab93b req-e03dfd2d-441f-4717-94df-15e36fcfbdb9 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:39.502255 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-7c7a7b80-8ccd-4d8f-8355-b973eebab93b req-e03dfd2d-441f-4717-94df-15e36fcfbdb9 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:39.512015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ff03d3f4-ec90-4a31-8009-1780a2b6adb9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:39.512677 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ff03d3f4-ec90-4a31-8009-1780a2b6adb9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:39.515165 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-7c7a7b80-8ccd-4d8f-8355-b973eebab93b req-e03dfd2d-441f-4717-94df-15e36fcfbdb9 service nova] Creating event network-changed:8a479ff1-a45a-48a2-afb3-db2272655b74 for instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 on hv-cinder-81966 May 26 13:50:39.521276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-7c7a7b80-8ccd-4d8f-8355-b973eebab93b req-e03dfd2d-441f-4717-94df-15e36fcfbdb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113919 May 26 13:50:39.522320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff03d3f4-ec90-4a31-8009-1780a2b6adb9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:39.522463 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 368/750] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:50:39.522798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff03d3f4-ec90-4a31-8009-1780a2b6adb9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:39.524691 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff03d3f4-ec90-4a31-8009-1780a2b6adb9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:39.525488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff03d3f4-ec90-4a31-8009-1780a2b6adb9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:39.690837 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ff03d3f4-ec90-4a31-8009-1780a2b6adb9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:39.700416 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ff03d3f4-ec90-4a31-8009-1780a2b6adb9 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.194882 May 26 13:50:39.701275 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 383/751] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:39 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:50:40.719153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bd426a30-12ad-482d-abad-1ea0ba76263d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:40.720052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bd426a30-12ad-482d-abad-1ea0ba76263d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:40.728365 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd426a30-12ad-482d-abad-1ea0ba76263d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:40.728820 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd426a30-12ad-482d-abad-1ea0ba76263d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:40.729613 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd426a30-12ad-482d-abad-1ea0ba76263d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:40.730043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd426a30-12ad-482d-abad-1ea0ba76263d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:40.891758 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bd426a30-12ad-482d-abad-1ea0ba76263d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:40.901446 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bd426a30-12ad-482d-abad-1ea0ba76263d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.186411 May 26 13:50:40.901748 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 369/752] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:40 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:41.537760 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-6e664778-7418-4549-a2d1-aee6784bef2a req-8ca565ff-97f8-4fc2-97c1-dbbea2a94748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda2ad3f-020c-4f84-8456-bd57ac8994a1", "tag": "8a479ff1-a45a-48a2-afb3-db2272655b74"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:50:41.546391 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-6e664778-7418-4549-a2d1-aee6784bef2a req-8ca565ff-97f8-4fc2-97c1-dbbea2a94748 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:41.546838 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-6e664778-7418-4549-a2d1-aee6784bef2a req-8ca565ff-97f8-4fc2-97c1-dbbea2a94748 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:41.562119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-6e664778-7418-4549-a2d1-aee6784bef2a req-8ca565ff-97f8-4fc2-97c1-dbbea2a94748 service nova] Creating event network-changed:8a479ff1-a45a-48a2-afb3-db2272655b74 for instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 on hv-cinder-81966 May 26 13:50:41.567341 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-6e664778-7418-4549-a2d1-aee6784bef2a req-8ca565ff-97f8-4fc2-97c1-dbbea2a94748 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033535 May 26 13:50:41.568014 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 384/753] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:50:41.919394 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e0138623-3fdf-4082-978e-36f1407d01bf tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:41.920099 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e0138623-3fdf-4082-978e-36f1407d01bf tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:41.927259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0138623-3fdf-4082-978e-36f1407d01bf tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:41.927664 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0138623-3fdf-4082-978e-36f1407d01bf tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:41.928487 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0138623-3fdf-4082-978e-36f1407d01bf tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:41.928917 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0138623-3fdf-4082-978e-36f1407d01bf tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:42.148618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e0138623-3fdf-4082-978e-36f1407d01bf tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:42.155954 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e0138623-3fdf-4082-978e-36f1407d01bf tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.240583 May 26 13:50:42.156540 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 370/754] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:41 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:43.175031 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-64c06ba5-d0da-41b9-8783-4ea030017800 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:43.175762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-64c06ba5-d0da-41b9-8783-4ea030017800 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:43.182755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-64c06ba5-d0da-41b9-8783-4ea030017800 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:43.183200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-64c06ba5-d0da-41b9-8783-4ea030017800 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:43.183961 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-64c06ba5-d0da-41b9-8783-4ea030017800 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:43.184495 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-64c06ba5-d0da-41b9-8783-4ea030017800 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:43.320480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-64c06ba5-d0da-41b9-8783-4ea030017800 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:43.328272 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-64c06ba5-d0da-41b9-8783-4ea030017800 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.158017 May 26 13:50:43.328877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 385/755] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:43 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:44.345383 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e25f950d-94ea-406a-8ed8-f861742ef1e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:44.345979 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e25f950d-94ea-406a-8ed8-f861742ef1e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:44.353321 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e25f950d-94ea-406a-8ed8-f861742ef1e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:44.353793 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e25f950d-94ea-406a-8ed8-f861742ef1e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:44.354564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e25f950d-94ea-406a-8ed8-f861742ef1e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:44.355002 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e25f950d-94ea-406a-8ed8-f861742ef1e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:44.484338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e25f950d-94ea-406a-8ed8-f861742ef1e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:44.493064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e25f950d-94ea-406a-8ed8-f861742ef1e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.151422 May 26 13:50:44.502759 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 371/756] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:44 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:45.509464 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0811c449-19cd-4d68-b22a-1b6b553cc08c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:45.510054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0811c449-19cd-4d68-b22a-1b6b553cc08c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:45.516603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0811c449-19cd-4d68-b22a-1b6b553cc08c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:45.517053 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0811c449-19cd-4d68-b22a-1b6b553cc08c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:45.517814 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0811c449-19cd-4d68-b22a-1b6b553cc08c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:45.518248 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0811c449-19cd-4d68-b22a-1b6b553cc08c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:45.653628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0811c449-19cd-4d68-b22a-1b6b553cc08c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:45.661418 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0811c449-19cd-4d68-b22a-1b6b553cc08c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1677 microversion: 2.1 time: 0.155853 May 26 13:50:45.661989 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 386/757] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:45 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:46.678714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2cdcb5d2-fc65-487d-bbbd-53af4369ea30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:46.679485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2cdcb5d2-fc65-487d-bbbd-53af4369ea30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:46.685893 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2cdcb5d2-fc65-487d-bbbd-53af4369ea30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:46.686331 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2cdcb5d2-fc65-487d-bbbd-53af4369ea30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:46.687078 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2cdcb5d2-fc65-487d-bbbd-53af4369ea30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:46.687505 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2cdcb5d2-fc65-487d-bbbd-53af4369ea30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:46.827129 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2cdcb5d2-fc65-487d-bbbd-53af4369ea30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:46.836200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2cdcb5d2-fc65-487d-bbbd-53af4369ea30 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1654 microversion: 2.1 time: 0.160672 May 26 13:50:46.836841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 372/758] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:46 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1654 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:46.852790 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bb77087a-0030-4ce4-9df5-7a859b012c94 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:50:46.859217 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bb77087a-0030-4ce4-9df5-7a859b012c94 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:46.859658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bb77087a-0030-4ce4-9df5-7a859b012c94 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:46.882442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bb77087a-0030-4ce4-9df5-7a859b012c94 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Going to try to start instance {{(pid=124240) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 13:50:46.926829 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bb77087a-0030-4ce4-9df5-7a859b012c94 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/action" status: 202 len: 0 microversion: 2.1 time: 0.078182 May 26 13:50:46.927439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 387/759] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:50:46 2022] POST /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:50:46.935897 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6532d6ab-7603-4d7c-811e-1b1d69bc3cbd tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:46.936536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6532d6ab-7603-4d7c-811e-1b1d69bc3cbd tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:46.942969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6532d6ab-7603-4d7c-811e-1b1d69bc3cbd tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:46.943331 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6532d6ab-7603-4d7c-811e-1b1d69bc3cbd tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:46.944387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6532d6ab-7603-4d7c-811e-1b1d69bc3cbd tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:46.945363 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6532d6ab-7603-4d7c-811e-1b1d69bc3cbd tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:47.111261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6532d6ab-7603-4d7c-811e-1b1d69bc3cbd tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:47.119391 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6532d6ab-7603-4d7c-811e-1b1d69bc3cbd tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1663 microversion: 2.1 time: 0.187431 May 26 13:50:47.119952 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 373/760] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:46 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1663 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:50:48.137866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-971fd750-62f6-41fa-b26f-d5563bc3ae2e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:50:48.138740 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-971fd750-62f6-41fa-b26f-d5563bc3ae2e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:50:48.145613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-971fd750-62f6-41fa-b26f-d5563bc3ae2e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:48.146066 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-971fd750-62f6-41fa-b26f-d5563bc3ae2e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:48.146842 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-971fd750-62f6-41fa-b26f-d5563bc3ae2e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:50:48.147372 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-971fd750-62f6-41fa-b26f-d5563bc3ae2e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:50:48.282817 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-971fd750-62f6-41fa-b26f-d5563bc3ae2e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:50:48.290859 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-971fd750-62f6-41fa-b26f-d5563bc3ae2e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1667 microversion: 2.1 time: 0.157862 May 26 13:50:48.291434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 388/761] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:50:48 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:00.022439 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3ec0b18a-6270-4760-8b6e-4695b08f2717 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:00.023096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3ec0b18a-6270-4760-8b6e-4695b08f2717 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:00.025358 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=47 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:00.025998 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=75 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:00.031756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ec0b18a-6270-4760-8b6e-4695b08f2717 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:00.032194 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ec0b18a-6270-4760-8b6e-4695b08f2717 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:00.032968 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ec0b18a-6270-4760-8b6e-4695b08f2717 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:00.033397 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ec0b18a-6270-4760-8b6e-4695b08f2717 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:00.056421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-3ec0b18a-6270-4760-8b6e-4695b08f2717 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lazy-loading 'flavor' on Instance uuid 2fb5af8d-022d-4708-aca9-49d3db482dcd {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:51:00.127911 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3ec0b18a-6270-4760-8b6e-4695b08f2717 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "POST /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd/action" status: 202 len: 0 microversion: 2.1 time: 0.109965 May 26 13:51:00.128526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 374/762] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:51:00 2022] POST /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:51:00.137083 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-49e83bfa-d574-4c86-9fd1-3defd3d8c791 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:00.137675 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-49e83bfa-d574-4c86-9fd1-3defd3d8c791 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:00.140155 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=29 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:00.140816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:00.146515 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49e83bfa-d574-4c86-9fd1-3defd3d8c791 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:00.147597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49e83bfa-d574-4c86-9fd1-3defd3d8c791 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:00.148434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49e83bfa-d574-4c86-9fd1-3defd3d8c791 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:00.148918 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49e83bfa-d574-4c86-9fd1-3defd3d8c791 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:00.287688 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-49e83bfa-d574-4c86-9fd1-3defd3d8c791 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:00.295164 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-49e83bfa-d574-4c86-9fd1-3defd3d8c791 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.162104 May 26 13:51:00.295735 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 389/763] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:00 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:01.313012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-60254d48-af45-4fbe-bbb8-cb07dcb51d84 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:01.313692 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-60254d48-af45-4fbe-bbb8-cb07dcb51d84 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:01.321716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60254d48-af45-4fbe-bbb8-cb07dcb51d84 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:01.322159 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60254d48-af45-4fbe-bbb8-cb07dcb51d84 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:01.322908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60254d48-af45-4fbe-bbb8-cb07dcb51d84 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:01.323335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-60254d48-af45-4fbe-bbb8-cb07dcb51d84 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:01.456958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-60254d48-af45-4fbe-bbb8-cb07dcb51d84 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:01.465517 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-60254d48-af45-4fbe-bbb8-cb07dcb51d84 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.157180 May 26 13:51:01.466070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 375/764] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:01 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:02.483865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-923c380f-5de9-4299-a4a6-ae20030a92c1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:02.484527 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-923c380f-5de9-4299-a4a6-ae20030a92c1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:02.491076 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-923c380f-5de9-4299-a4a6-ae20030a92c1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:02.491526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-923c380f-5de9-4299-a4a6-ae20030a92c1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:02.492288 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-923c380f-5de9-4299-a4a6-ae20030a92c1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:02.492747 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-923c380f-5de9-4299-a4a6-ae20030a92c1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:02.627016 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-923c380f-5de9-4299-a4a6-ae20030a92c1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:02.635686 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-923c380f-5de9-4299-a4a6-ae20030a92c1 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.155642 May 26 13:51:02.636260 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 390/765] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:02 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:03.514550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-13dba1b5-3c9d-4566-97a8-f74dcd246079 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:03.515167 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-13dba1b5-3c9d-4566-97a8-f74dcd246079 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:03.522538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13dba1b5-3c9d-4566-97a8-f74dcd246079 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:03.523115 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13dba1b5-3c9d-4566-97a8-f74dcd246079 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:03.523921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13dba1b5-3c9d-4566-97a8-f74dcd246079 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:03.524421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13dba1b5-3c9d-4566-97a8-f74dcd246079 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:03.553919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-13dba1b5-3c9d-4566-97a8-f74dcd246079 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments/9f0fd5d4-9365-40a4-a4af-a9cb36ef2dd2" status: 200 len: 194 microversion: 2.20 time: 0.043481 May 26 13:51:03.554529 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 376/766] 10.222.0.16 () {60 vars in 1453 bytes} [Thu May 26 13:51:03 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments/9f0fd5d4-9365-40a4-a4af-a9cb36ef2dd2 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:51:03.619689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-70193bea-94c7-4410-95a4-d3d40e193bf8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:03.620225 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-70193bea-94c7-4410-95a4-d3d40e193bf8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:03.626664 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-70193bea-94c7-4410-95a4-d3d40e193bf8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:03.627121 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-70193bea-94c7-4410-95a4-d3d40e193bf8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:03.627889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-70193bea-94c7-4410-95a4-d3d40e193bf8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:03.628348 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-70193bea-94c7-4410-95a4-d3d40e193bf8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:03.652569 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f06fb2fa-94ca-49b4-ab63-c62f0864eab7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:03.653245 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f06fb2fa-94ca-49b4-ab63-c62f0864eab7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:03.659433 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f06fb2fa-94ca-49b4-ab63-c62f0864eab7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:03.660531 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f06fb2fa-94ca-49b4-ab63-c62f0864eab7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:03.660675 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f06fb2fa-94ca-49b4-ab63-c62f0864eab7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:03.661141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f06fb2fa-94ca-49b4-ab63-c62f0864eab7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:03.711168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-70193bea-94c7-4410-95a4-d3d40e193bf8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lazy-loading 'services' on Instance uuid ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:51:03.791619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-70193bea-94c7-4410-95a4-d3d40e193bf8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments/9f0fd5d4-9365-40a4-a4af-a9cb36ef2dd2" status: 202 len: 0 microversion: 2.20 time: 0.176631 May 26 13:51:03.796038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 391/767] 10.222.0.16 () {60 vars in 1456 bytes} [Thu May 26 13:51:03 2022] DELETE /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments/9f0fd5d4-9365-40a4-a4af-a9cb36ef2dd2 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 13:51:03.801892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-88b5a001-b957-4d9f-9486-31b8e3e0feaf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:03.802959 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-88b5a001-b957-4d9f-9486-31b8e3e0feaf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:03.807042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f06fb2fa-94ca-49b4-ab63-c62f0864eab7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:03.810069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-88b5a001-b957-4d9f-9486-31b8e3e0feaf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:03.810520 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-88b5a001-b957-4d9f-9486-31b8e3e0feaf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:03.811491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-88b5a001-b957-4d9f-9486-31b8e3e0feaf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:03.811924 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-88b5a001-b957-4d9f-9486-31b8e3e0feaf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:03.816079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f06fb2fa-94ca-49b4-ab63-c62f0864eab7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.167276 May 26 13:51:03.817999 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 377/768] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:03 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:03.843232 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-88b5a001-b957-4d9f-9486-31b8e3e0feaf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045601 May 26 13:51:03.843797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 392/769] 10.222.0.16 () {60 vars in 1342 bytes} [Thu May 26 13:51:03 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:51:04.835721 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-93edc881-899f-467b-8551-b95bfeab6348 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:04.836355 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-93edc881-899f-467b-8551-b95bfeab6348 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:04.842860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93edc881-899f-467b-8551-b95bfeab6348 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:04.843312 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93edc881-899f-467b-8551-b95bfeab6348 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:04.844083 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93edc881-899f-467b-8551-b95bfeab6348 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:04.844559 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93edc881-899f-467b-8551-b95bfeab6348 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:04.855224 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-39150112-d90e-4fee-8262-6f1134005be7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:04.856142 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-39150112-d90e-4fee-8262-6f1134005be7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:04.862688 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-39150112-d90e-4fee-8262-6f1134005be7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:04.863145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-39150112-d90e-4fee-8262-6f1134005be7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:04.863910 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-39150112-d90e-4fee-8262-6f1134005be7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:04.864364 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-39150112-d90e-4fee-8262-6f1134005be7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:04.894837 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-39150112-d90e-4fee-8262-6f1134005be7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043559 May 26 13:51:04.895414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 393/770] 10.222.0.16 () {60 vars in 1342 bytes} [Thu May 26 13:51:04 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:04.972970 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ff8394af-02ab-4b46-b5c8-33a30413a9c8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:04.973456 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ff8394af-02ab-4b46-b5c8-33a30413a9c8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:04.979922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff8394af-02ab-4b46-b5c8-33a30413a9c8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:04.980395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff8394af-02ab-4b46-b5c8-33a30413a9c8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:04.981163 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff8394af-02ab-4b46-b5c8-33a30413a9c8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:04.981588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ff8394af-02ab-4b46-b5c8-33a30413a9c8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:04.996514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-93edc881-899f-467b-8551-b95bfeab6348 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:05.003988 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-93edc881-899f-467b-8551-b95bfeab6348 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.173025 May 26 13:51:05.004586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 378/771] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:04 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:05.008884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ff8394af-02ab-4b46-b5c8-33a30413a9c8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:51:05.092766 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ff8394af-02ab-4b46-b5c8-33a30413a9c8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 204 len: 0 microversion: 2.20 time: 0.123302 May 26 13:51:05.093333 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 394/772] 10.222.0.16 () {60 vars in 1279 bytes} [Thu May 26 13:51:04 2022] DELETE /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 13:51:05.102411 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:05.103012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:05.109111 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:05.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:05.110319 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:05.110718 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:05.240900 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:05.249380 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:05.250955 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:05.252160 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e9433386-ef80-4448-ab37-56ecb529e4d2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.154143 May 26 13:51:05.252822 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 379/773] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:05 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:06.022592 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-434b06f6-a3ee-451b-a083-dd8147215168 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:06.023292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-434b06f6-a3ee-451b-a083-dd8147215168 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:06.029821 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-434b06f6-a3ee-451b-a083-dd8147215168 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:06.030259 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-434b06f6-a3ee-451b-a083-dd8147215168 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:06.031021 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-434b06f6-a3ee-451b-a083-dd8147215168 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:06.031454 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-434b06f6-a3ee-451b-a083-dd8147215168 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:06.165218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-434b06f6-a3ee-451b-a083-dd8147215168 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:06.172993 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-434b06f6-a3ee-451b-a083-dd8147215168 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.154938 May 26 13:51:06.173531 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 395/774] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:06 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:06.270919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:06.271513 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:06.278568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:06.279013 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:06.279779 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:06.280211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:06.634144 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:06.642079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:06.643563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:06.644742 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2294d9a7-5ae5-4446-93af-47f8c43d01cb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1725 microversion: 2.20 time: 0.377735 May 26 13:51:06.645301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 380/775] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:06 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1725 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:07.189578 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e531d13a-593a-4328-8cfc-222f587ee730 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:07.190884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e531d13a-593a-4328-8cfc-222f587ee730 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:07.198186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e531d13a-593a-4328-8cfc-222f587ee730 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:07.198639 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e531d13a-593a-4328-8cfc-222f587ee730 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:07.199451 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e531d13a-593a-4328-8cfc-222f587ee730 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:07.199882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e531d13a-593a-4328-8cfc-222f587ee730 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:07.331744 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e531d13a-593a-4328-8cfc-222f587ee730 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:07.339955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e531d13a-593a-4328-8cfc-222f587ee730 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.154197 May 26 13:51:07.340810 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 396/776] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:07 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:07.664366 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:07.664979 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:07.671691 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:07.672214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:07.673026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:07.673646 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:07.782706 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:07.791375 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:07.792994 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:07.794232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-162c2be8-b8db-4de6-897f-98a87ae90e3d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 200 len: 1657 microversion: 2.20 time: 0.134936 May 26 13:51:07.794842 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 381/777] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:07 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 1657 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:07.963248 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-ce801b46-20a0-4b0d-b526-061e8feb4128 req-945a700f-8f81-46b0-8426-520180f429e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef326f08-0e4f-4ad0-9f62-f4197ccf5b65", "name": "network-vif-deleted", "tag": "914816b6-d98c-46f8-9da7-123cb0956236"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:07.972011 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-ce801b46-20a0-4b0d-b526-061e8feb4128 req-945a700f-8f81-46b0-8426-520180f429e9 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:07.972497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-ce801b46-20a0-4b0d-b526-061e8feb4128 req-945a700f-8f81-46b0-8426-520180f429e9 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:07.985510 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-ce801b46-20a0-4b0d-b526-061e8feb4128 req-945a700f-8f81-46b0-8426-520180f429e9 service nova] Creating event network-vif-deleted:914816b6-d98c-46f8-9da7-123cb0956236 for instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 on hv-cinder-81966 May 26 13:51:07.990921 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-ce801b46-20a0-4b0d-b526-061e8feb4128 req-945a700f-8f81-46b0-8426-520180f429e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031553 May 26 13:51:07.991549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 397/778] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:08.356323 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-765500c2-fb60-433e-8f24-77fde3263b6c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:08.356927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-765500c2-fb60-433e-8f24-77fde3263b6c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:08.362954 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-765500c2-fb60-433e-8f24-77fde3263b6c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:08.363393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-765500c2-fb60-433e-8f24-77fde3263b6c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:08.364154 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-765500c2-fb60-433e-8f24-77fde3263b6c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:08.364613 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-765500c2-fb60-433e-8f24-77fde3263b6c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:08.559003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-765500c2-fb60-433e-8f24-77fde3263b6c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:08.569252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-765500c2-fb60-433e-8f24-77fde3263b6c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.215808 May 26 13:51:08.569916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 382/779] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:08 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:08.812977 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:08.813785 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:08.821397 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:08.822045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:08.822778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:08.823220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:08.838046 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] HTTP exception thrown: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Request method failure captured: May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 HTTP/1.1 May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RK6Q5zvrEcfThxe3m9zcYEAzewaUpJSUecdteBtkN2ABp6CEa_YvmyqibvC62J4VuO176aAYiCSy9P0AJXlsGeND5y5wTScFxIJl_gCIIAwlZa3fyD3YR5E6H-CsG0OivjqsuzG62tMZ1wauGmXmUJVuQ8GpcCymNt9nH1zr5RnLE May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Openstack-Nova-Api-Version: 2.20 May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:51:08.839708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ce476b2a1764f56b9780f4a5c75ac3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: e13f5cad16824554a1fb32ed9a915ae9 May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:51:08.841358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'ef326f08-0e4f-4ad0-9f62-f4197ccf5b65'} May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:51:08.842290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:51:08.843899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:08.845843 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Returning 404 to user: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:51:08.846680 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c77c2239-6905-41b4-a9dd-0c815eda219c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 404 len: 111 microversion: 2.20 time: 0.038317 May 26 13:51:08.847299 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 398/780] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:08 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 13:51:08.857960 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-af22f378-0625-4d02-8b2c-41f079e1f3e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '.version_select at 0x7f07e0374af0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:08.881906 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-af22f378-0625-4d02-8b2c-41f079e1f3e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508599193" status: 204 len: 0 microversion: 2.20 time: 0.027605 May 26 13:51:08.882620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 383/781] 10.222.0.16 () {60 vars in 1258 bytes} [Thu May 26 13:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508599193 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 13:51:09.577732 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a1546587-3670-4579-ade5-787bd021d839 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'create', calling method: .version_select at 0x7f07e04941f0>, body: {"keypair": {"name": "tempest-keypair-1526375349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAtC1shOwtVp7G0C6fpkDsMFEJ1Y5iH+xnNq1KjNRD9KMbpoLGl18ylogGg24e+w4FpUVawNjgyBgNGqYlbu0xga/MafFqSHafRD3Q767jbglTuwv/HTq6zdfgwTGADLQ=="}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:09.586817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6047dcea-e7e7-4035-9768-06621cfe84c8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:09.587864 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6047dcea-e7e7-4035-9768-06621cfe84c8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:09.593071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-a1546587-3670-4579-ade5-787bd021d839 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Getting quotas for project 1ce476b2a1764f56b9780f4a5c75ac3d. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:51:09.594986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6047dcea-e7e7-4035-9768-06621cfe84c8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:09.595682 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6047dcea-e7e7-4035-9768-06621cfe84c8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:09.596804 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6047dcea-e7e7-4035-9768-06621cfe84c8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:09.597075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-a1546587-3670-4579-ade5-787bd021d839 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Getting quotas for user e13f5cad16824554a1fb32ed9a915ae9 and project 1ce476b2a1764f56b9780f4a5c75ac3d. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:51:09.597446 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6047dcea-e7e7-4035-9768-06621cfe84c8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:09.622615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a1546587-3670-4579-ade5-787bd021d839 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048740 May 26 13:51:09.623450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 399/782] 10.222.0.16 () {62 vars in 1199 bytes} [Thu May 26 13:51:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 13:51:09.781933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6047dcea-e7e7-4035-9768-06621cfe84c8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:09.791269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6047dcea-e7e7-4035-9768-06621cfe84c8 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.209429 May 26 13:51:09.792095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 384/783] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:09 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:10.809925 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2502e65a-9f24-4b0e-b725-1658b0ac7292 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:10.811351 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2502e65a-9f24-4b0e-b725-1658b0ac7292 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:10.820872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2502e65a-9f24-4b0e-b725-1658b0ac7292 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:10.821676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2502e65a-9f24-4b0e-b725-1658b0ac7292 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:10.822732 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2502e65a-9f24-4b0e-b725-1658b0ac7292 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:10.823719 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2502e65a-9f24-4b0e-b725-1658b0ac7292 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:10.987380 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2502e65a-9f24-4b0e-b725-1658b0ac7292 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:10.997639 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2502e65a-9f24-4b0e-b725-1658b0ac7292 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.192071 May 26 13:51:10.998583 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 400/784] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:10 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:11.434213 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1909770121", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7243f764-410e-4885-acdc-a415825d1293"}], "security_groups": [{"name": "tempest-securitygroup--1640351430"}], "key_name": "tempest-keypair-1526375349", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:11.536439 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] validate_networks() for [('7243f764-410e-4885-acdc-a415825d1293', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:51:11.959790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:51:11.960200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:51:11.960696 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:51:11.961094 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:51:11.961531 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:51:11.970360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:11.970797 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:11.971637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:11.972060 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:11.988792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Getting quotas for project 1ce476b2a1764f56b9780f4a5c75ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:51:11.992642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Getting quotas for user e13f5cad16824554a1fb32ed9a915ae9 and project 1ce476b2a1764f56b9780f4a5c75ac3d. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:51:12.003321 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:51:12.005590 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:51:12.015424 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-32995b1d-caee-4520-90c8-bcd6180a65a6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:12.016030 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-32995b1d-caee-4520-90c8-bcd6180a65a6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:12.023298 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32995b1d-caee-4520-90c8-bcd6180a65a6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:12.023742 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32995b1d-caee-4520-90c8-bcd6180a65a6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:12.024544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32995b1d-caee-4520-90c8-bcd6180a65a6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:12.024990 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32995b1d-caee-4520-90c8-bcd6180a65a6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:12.054469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a73936cb-6b91-41b8-aaa3-8003636465e5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.624501 May 26 13:51:12.055636 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 385/785] 10.222.0.16 () {62 vars in 1187 bytes} [Thu May 26 13:51:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 13:51:12.065575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2e33d997-631a-4664-8dc2-b599e1e6ed65 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:12.066270 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2e33d997-631a-4664-8dc2-b599e1e6ed65 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:12.121593 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2e33d997-631a-4664-8dc2-b599e1e6ed65 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:12.130215 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2e33d997-631a-4664-8dc2-b599e1e6ed65 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:12.132104 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2e33d997-631a-4664-8dc2-b599e1e6ed65 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:12.133271 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2e33d997-631a-4664-8dc2-b599e1e6ed65 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1282 microversion: 2.20 time: 0.071665 May 26 13:51:12.139946 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 386/786] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:12 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:51:12.175728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-32995b1d-caee-4520-90c8-bcd6180a65a6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:12.183477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-32995b1d-caee-4520-90c8-bcd6180a65a6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.171859 May 26 13:51:12.184053 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 401/787] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:12 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:13.151338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c9009724-e2f3-4522-9cce-4d08042972ff tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:13.152218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c9009724-e2f3-4522-9cce-4d08042972ff tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:13.202046 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3895fc1e-90b6-4add-bea1-73b6e7bec5d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:13.202665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3895fc1e-90b6-4add-bea1-73b6e7bec5d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:13.216491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3895fc1e-90b6-4add-bea1-73b6e7bec5d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:13.216944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3895fc1e-90b6-4add-bea1-73b6e7bec5d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:13.217734 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3895fc1e-90b6-4add-bea1-73b6e7bec5d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:13.220562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3895fc1e-90b6-4add-bea1-73b6e7bec5d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:13.243123 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c9009724-e2f3-4522-9cce-4d08042972ff tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:13.252952 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c9009724-e2f3-4522-9cce-4d08042972ff tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:13.255015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c9009724-e2f3-4522-9cce-4d08042972ff tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:13.256742 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c9009724-e2f3-4522-9cce-4d08042972ff tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1282 microversion: 2.20 time: 0.109581 May 26 13:51:13.258032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 387/788] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:13 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:13.382390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3895fc1e-90b6-4add-bea1-73b6e7bec5d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:13.390244 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3895fc1e-90b6-4add-bea1-73b6e7bec5d6 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1572 microversion: 2.1 time: 0.194110 May 26 13:51:13.390812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 402/789] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:13 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1572 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:13.407094 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5b3c3415-2df6-495a-a8a8-dacd7d65215c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:13.407657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5b3c3415-2df6-495a-a8a8-dacd7d65215c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:13.414935 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b3c3415-2df6-495a-a8a8-dacd7d65215c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:13.415383 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b3c3415-2df6-495a-a8a8-dacd7d65215c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:13.416143 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b3c3415-2df6-495a-a8a8-dacd7d65215c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:13.416606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b3c3415-2df6-495a-a8a8-dacd7d65215c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:13.514131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5b3c3415-2df6-495a-a8a8-dacd7d65215c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "POST /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd/action" status: 202 len: 0 microversion: 2.1 time: 0.110883 May 26 13:51:13.515046 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 388/790] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:51:13 2022] POST /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:51:13.524040 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3bfcd40a-2a51-4e5d-9ab0-7a3d92ca6c4e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:13.524693 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3bfcd40a-2a51-4e5d-9ab0-7a3d92ca6c4e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:13.533364 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3bfcd40a-2a51-4e5d-9ab0-7a3d92ca6c4e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:13.533821 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3bfcd40a-2a51-4e5d-9ab0-7a3d92ca6c4e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:13.534715 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3bfcd40a-2a51-4e5d-9ab0-7a3d92ca6c4e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:13.535360 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3bfcd40a-2a51-4e5d-9ab0-7a3d92ca6c4e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:13.703818 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3bfcd40a-2a51-4e5d-9ab0-7a3d92ca6c4e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:13.712974 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3bfcd40a-2a51-4e5d-9ab0-7a3d92ca6c4e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1580 microversion: 2.1 time: 0.193362 May 26 13:51:13.713465 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 403/791] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:13 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1580 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:14.275992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:14.277438 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:14.285568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:14.286352 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:14.287279 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:14.287856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:14.490660 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:14.498898 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:14.500437 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:14.501552 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cf8d5eb8-0a73-485a-bb45-dc8010372b76 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1352 microversion: 2.20 time: 0.230251 May 26 13:51:14.502117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 389/792] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:14 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1352 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:51:14.730298 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-65a34297-2f2b-41d3-97f0-8ac4c3e0aec9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:14.730913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-65a34297-2f2b-41d3-97f0-8ac4c3e0aec9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:14.738622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-65a34297-2f2b-41d3-97f0-8ac4c3e0aec9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:14.739003 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-65a34297-2f2b-41d3-97f0-8ac4c3e0aec9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:14.740041 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-65a34297-2f2b-41d3-97f0-8ac4c3e0aec9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:14.741073 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-65a34297-2f2b-41d3-97f0-8ac4c3e0aec9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:14.913748 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-65a34297-2f2b-41d3-97f0-8ac4c3e0aec9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:14.925229 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-65a34297-2f2b-41d3-97f0-8ac4c3e0aec9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1522 microversion: 2.1 time: 0.198497 May 26 13:51:14.925944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 404/793] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:14 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:15.519660 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:15.520725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:15.528620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:15.530109 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:15.531183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:15.531798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:15.556930 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:15.578599 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-bd1fa02d-3ae7-488d-afc3-02b8a3a4d14d req-1cf2bebf-06df-4d73-b6fa-11ecdbe76b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb5af8d-022d-4708-aca9-49d3db482dcd", "name": "network-vif-unplugged", "status": "completed", "tag": "04d681e3-ceab-4cf6-876e-aec8b3942d85"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:15.592910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-bd1fa02d-3ae7-488d-afc3-02b8a3a4d14d req-1cf2bebf-06df-4d73-b6fa-11ecdbe76b6b service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:15.593477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-bd1fa02d-3ae7-488d-afc3-02b8a3a4d14d req-1cf2bebf-06df-4d73-b6fa-11ecdbe76b6b service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:15.714784 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:15.726328 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:15.728337 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:15.729790 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3aea89e6-4b34-4719-afc8-5d22e9a97b5f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.214219 May 26 13:51:15.731304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 405/794] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:15 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:51:15.783522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-bd1fa02d-3ae7-488d-afc3-02b8a3a4d14d req-1cf2bebf-06df-4d73-b6fa-11ecdbe76b6b service nova] Creating event network-vif-unplugged:04d681e3-ceab-4cf6-876e-aec8b3942d85 for instance 2fb5af8d-022d-4708-aca9-49d3db482dcd on hv-cinder-81966 May 26 13:51:15.788653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-bd1fa02d-3ae7-488d-afc3-02b8a3a4d14d req-1cf2bebf-06df-4d73-b6fa-11ecdbe76b6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.292247 May 26 13:51:15.789450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 390/795] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:15.942956 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b1039e2f-bcee-4eda-93d4-517c281864cc tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:15.944718 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b1039e2f-bcee-4eda-93d4-517c281864cc tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:15.951383 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1039e2f-bcee-4eda-93d4-517c281864cc tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:15.951837 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1039e2f-bcee-4eda-93d4-517c281864cc tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:15.952735 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1039e2f-bcee-4eda-93d4-517c281864cc tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:15.953173 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b1039e2f-bcee-4eda-93d4-517c281864cc tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:16.101372 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b1039e2f-bcee-4eda-93d4-517c281864cc tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:16.114758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b1039e2f-bcee-4eda-93d4-517c281864cc tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.173417 May 26 13:51:16.117215 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 406/796] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:15 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:16.409209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-89b20624-0f8f-4cf4-acde-0c5778d8399c req-9b112bd4-e696-48a9-8974-3a0572803c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeccb394-4413-411c-a93c-9fbec3f06537", "tag": "7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:16.418732 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-89b20624-0f8f-4cf4-acde-0c5778d8399c req-9b112bd4-e696-48a9-8974-3a0572803c67 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:16.419172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-89b20624-0f8f-4cf4-acde-0c5778d8399c req-9b112bd4-e696-48a9-8974-3a0572803c67 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:16.431024 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-89b20624-0f8f-4cf4-acde-0c5778d8399c req-9b112bd4-e696-48a9-8974-3a0572803c67 service nova] Creating event network-changed:7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa for instance aeccb394-4413-411c-a93c-9fbec3f06537 on hv-cinder-81966 May 26 13:51:16.435923 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-89b20624-0f8f-4cf4-acde-0c5778d8399c req-9b112bd4-e696-48a9-8974-3a0572803c67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031636 May 26 13:51:16.436842 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 391/797] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:16.748526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:16.749133 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:16.755111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:16.755556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:16.756347 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:16.756782 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:16.892941 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:16.900805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:16.902302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:16.903402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dc74eba4-f8e1-4105-9a04-9d63493a7d79 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.158946 May 26 13:51:16.903966 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 407/798] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:16 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:17.134619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-304d1487-00f9-4019-94e7-3c05a9e9bca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:17.135311 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-304d1487-00f9-4019-94e7-3c05a9e9bca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:17.141638 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-304d1487-00f9-4019-94e7-3c05a9e9bca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:17.142026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-304d1487-00f9-4019-94e7-3c05a9e9bca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:17.142818 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-304d1487-00f9-4019-94e7-3c05a9e9bca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:17.143257 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-304d1487-00f9-4019-94e7-3c05a9e9bca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:17.161516 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:17.277586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-304d1487-00f9-4019-94e7-3c05a9e9bca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:17.285233 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-304d1487-00f9-4019-94e7-3c05a9e9bca4 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.155530 May 26 13:51:17.285820 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 392/799] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:17 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:17.922363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:17.923307 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:17.930668 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:17.931187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:17.932060 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:17.932754 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:18.065199 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:18.073439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:18.074918 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:18.076008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0c2b57c2-de23-4ed4-8183-27b613d714cf tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.158095 May 26 13:51:18.076597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 408/800] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:17 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:18.302845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e15a6c46-356a-47a2-bf73-df1305c5febb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:18.303367 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e15a6c46-356a-47a2-bf73-df1305c5febb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:18.309918 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e15a6c46-356a-47a2-bf73-df1305c5febb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:18.310369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e15a6c46-356a-47a2-bf73-df1305c5febb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:18.311132 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e15a6c46-356a-47a2-bf73-df1305c5febb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:18.311564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e15a6c46-356a-47a2-bf73-df1305c5febb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:18.444461 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e15a6c46-356a-47a2-bf73-df1305c5febb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:18.452064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e15a6c46-356a-47a2-bf73-df1305c5febb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.153128 May 26 13:51:18.452740 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 393/801] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:18 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:19.094527 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:19.095055 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:19.101116 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:19.101569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:19.102336 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:19.102774 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:19.236905 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:19.245745 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:19.247233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:19.248417 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-cebe607d-5c67-4c7b-ae41-707e725b4449 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.157953 May 26 13:51:19.248971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 409/802] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:19 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:19.334263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ab4f4251-cad1-4099-b34f-9ac039c0f78b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1468382374"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:19.334874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab4f4251-cad1-4099-b34f-9ac039c0f78b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:19.341859 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab4f4251-cad1-4099-b34f-9ac039c0f78b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:19.342310 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab4f4251-cad1-4099-b34f-9ac039c0f78b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:19.343072 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab4f4251-cad1-4099-b34f-9ac039c0f78b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:19.343504 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab4f4251-cad1-4099-b34f-9ac039c0f78b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:19.471778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8a03a2a3-93bb-4640-8064-4117987cb1d7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:19.472440 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8a03a2a3-93bb-4640-8064-4117987cb1d7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:19.474976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.network.security_group_api [None req-ab4f4251-cad1-4099-b34f-9ac039c0f78b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Removing security group 4fef4f7b-39dd-464a-8c6c-49f468a88961 from port e0662874-78ce-4387-a824-8ab106baa767 May 26 13:51:19.479286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a03a2a3-93bb-4640-8064-4117987cb1d7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:19.479740 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a03a2a3-93bb-4640-8064-4117987cb1d7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:19.480546 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a03a2a3-93bb-4640-8064-4117987cb1d7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:19.480986 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8a03a2a3-93bb-4640-8064-4117987cb1d7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:19.604416 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=4 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:19.614238 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8a03a2a3-93bb-4640-8064-4117987cb1d7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:19.622976 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8a03a2a3-93bb-4640-8064-4117987cb1d7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.156992 May 26 13:51:19.623546 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 410/803] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:19 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:19.872591 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ab4f4251-cad1-4099-b34f-9ac039c0f78b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "POST /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.542138 May 26 13:51:19.873249 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 394/804] 10.222.0.16 () {60 vars in 1277 bytes} [Thu May 26 13:51:19 2022] POST /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:51:19.894718 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-f4ca627e-65b4-42bd-83b1-f9ef1d11e49a req-60b24fc3-1700-4c60-8635-a82da20c87c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ad193e-1516-41cd-8603-74830f1c6fc7", "tag": "e0662874-78ce-4387-a824-8ab106baa767"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:19.919172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-f4ca627e-65b4-42bd-83b1-f9ef1d11e49a req-60b24fc3-1700-4c60-8635-a82da20c87c5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:19.920129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-f4ca627e-65b4-42bd-83b1-f9ef1d11e49a req-60b24fc3-1700-4c60-8635-a82da20c87c5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:19.939762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-f4ca627e-65b4-42bd-83b1-f9ef1d11e49a req-60b24fc3-1700-4c60-8635-a82da20c87c5 service nova] Creating event network-changed:e0662874-78ce-4387-a824-8ab106baa767 for instance 39ad193e-1516-41cd-8603-74830f1c6fc7 on hv-cinder-81966 May 26 13:51:19.948936 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-f4ca627e-65b4-42bd-83b1-f9ef1d11e49a req-60b24fc3-1700-4c60-8635-a82da20c87c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060858 May 26 13:51:19.950306 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 411/805] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:20.274087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:20.275022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:20.285871 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:20.286333 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:20.287681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:20.288084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:20.560755 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:20.569172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:20.570700 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:20.571860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-337ddb8b-c648-40d9-8138-b8c874154c4f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.308070 May 26 13:51:20.572755 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 395/806] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:20 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:20.641241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a8881410-8ffd-4ff0-bca9-f2b93f5875f2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:20.641863 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a8881410-8ffd-4ff0-bca9-f2b93f5875f2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:20.649903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a8881410-8ffd-4ff0-bca9-f2b93f5875f2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:20.650342 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a8881410-8ffd-4ff0-bca9-f2b93f5875f2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:20.651110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a8881410-8ffd-4ff0-bca9-f2b93f5875f2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:20.651541 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a8881410-8ffd-4ff0-bca9-f2b93f5875f2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:20.795702 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a8881410-8ffd-4ff0-bca9-f2b93f5875f2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:20.804249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a8881410-8ffd-4ff0-bca9-f2b93f5875f2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.167191 May 26 13:51:20.805118 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 412/807] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:20 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:21.592648 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:21.593377 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:21.600588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:21.601031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:21.601806 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:21.602233 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:21.823459 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8db94e63-897d-46c9-9495-28cec0ff2bd0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:21.824054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8db94e63-897d-46c9-9495-28cec0ff2bd0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:21.831402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:21.831690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8db94e63-897d-46c9-9495-28cec0ff2bd0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:21.832164 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8db94e63-897d-46c9-9495-28cec0ff2bd0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:21.832954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8db94e63-897d-46c9-9495-28cec0ff2bd0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:21.833703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8db94e63-897d-46c9-9495-28cec0ff2bd0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:21.840676 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:21.842449 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:21.843577 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-efd13066-5fa2-4fe8-8688-bbec78b6e683 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.256661 May 26 13:51:21.844751 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 396/808] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:21 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:21.851464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b49f4d94-be0b-4aa6-81e3-b0d5d06d5c2a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:21.852436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b49f4d94-be0b-4aa6-81e3-b0d5d06d5c2a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:21.859327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b49f4d94-be0b-4aa6-81e3-b0d5d06d5c2a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:21.859777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b49f4d94-be0b-4aa6-81e3-b0d5d06d5c2a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:21.860615 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b49f4d94-be0b-4aa6-81e3-b0d5d06d5c2a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:21.861051 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b49f4d94-be0b-4aa6-81e3-b0d5d06d5c2a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:21.964428 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-b49f4d94-be0b-4aa6-81e3-b0d5d06d5c2a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lazy-loading 'services' on Instance uuid 39ad193e-1516-41cd-8603-74830f1c6fc7 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:51:21.984053 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8db94e63-897d-46c9-9495-28cec0ff2bd0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:21.992211 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8db94e63-897d-46c9-9495-28cec0ff2bd0 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.173898 May 26 13:51:22.000604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:22.001964 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 413/809] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:21 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:22.007466 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-bd887909-e78b-4230-88a6-a8dded991b19 req-3b9040e7-82a0-45d2-8484-6b361644232f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ad193e-1516-41cd-8603-74830f1c6fc7", "tag": "e0662874-78ce-4387-a824-8ab106baa767"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:22.015650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-bd887909-e78b-4230-88a6-a8dded991b19 req-3b9040e7-82a0-45d2-8484-6b361644232f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:22.016361 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-bd887909-e78b-4230-88a6-a8dded991b19 req-3b9040e7-82a0-45d2-8484-6b361644232f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:22.033247 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-bd887909-e78b-4230-88a6-a8dded991b19 req-3b9040e7-82a0-45d2-8484-6b361644232f service nova] Creating event network-changed:e0662874-78ce-4387-a824-8ab106baa767 for instance 39ad193e-1516-41cd-8603-74830f1c6fc7 on hv-cinder-81966 May 26 13:51:22.040867 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-bd887909-e78b-4230-88a6-a8dded991b19 req-3b9040e7-82a0-45d2-8484-6b361644232f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037212 May 26 13:51:22.060211 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 414/810] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:22.093865 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b49f4d94-be0b-4aa6-81e3-b0d5d06d5c2a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments/ae5100ea-6775-46be-b751-4781f37aa0b5" status: 202 len: 0 microversion: 2.1 time: 0.247231 May 26 13:51:22.094929 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 397/811] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 13:51:21 2022] DELETE /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments/ae5100ea-6775-46be-b751-4781f37aa0b5 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:51:22.105515 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-152d8b8c-12eb-4d78-a291-53f1f408388c tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:22.105914 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-152d8b8c-12eb-4d78-a291-53f1f408388c tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:22.120721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-152d8b8c-12eb-4d78-a291-53f1f408388c tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:22.121352 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-152d8b8c-12eb-4d78-a291-53f1f408388c tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:22.122565 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-152d8b8c-12eb-4d78-a291-53f1f408388c tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:22.123189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-152d8b8c-12eb-4d78-a291-53f1f408388c tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:22.160945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-152d8b8c-12eb-4d78-a291-53f1f408388c tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060387 May 26 13:51:22.162441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 415/812] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:51:22 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:22.863618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:22.864335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:22.871385 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:22.871829 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:22.872642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:22.873071 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:23.010601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-aa2c8c79-38ba-4959-90b0-e2c3b16bfcca tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:23.011092 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:23.011446 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-aa2c8c79-38ba-4959-90b0-e2c3b16bfcca tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:23.019181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c79-38ba-4959-90b0-e2c3b16bfcca tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:23.019942 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c79-38ba-4959-90b0-e2c3b16bfcca tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:23.020229 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:23.021084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c79-38ba-4959-90b0-e2c3b16bfcca tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:23.021666 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-aa2c8c79-38ba-4959-90b0-e2c3b16bfcca tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:23.022243 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:23.023364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-202ce7f5-fe67-4a80-a5d9-bb67410dc17a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.164573 May 26 13:51:23.024168 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 398/813] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:22 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:23.156611 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-aa2c8c79-38ba-4959-90b0-e2c3b16bfcca tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:23.164626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-aa2c8c79-38ba-4959-90b0-e2c3b16bfcca tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.159106 May 26 13:51:23.165185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 416/814] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:23 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:23.173025 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c62db42f-c79a-42cf-8580-ee22068fbc81 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:23.174011 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c62db42f-c79a-42cf-8580-ee22068fbc81 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:23.181136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c62db42f-c79a-42cf-8580-ee22068fbc81 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:23.181582 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c62db42f-c79a-42cf-8580-ee22068fbc81 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:23.182360 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c62db42f-c79a-42cf-8580-ee22068fbc81 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:23.182795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c62db42f-c79a-42cf-8580-ee22068fbc81 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:23.213005 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c62db42f-c79a-42cf-8580-ee22068fbc81 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 May 26 13:51:23.213492 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 399/815] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:51:23 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:23.608375 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-bdaa6936-19e6-4d67-b697-f1641e5f3cf8 req-d835dd98-662d-4f86-b691-a7ebc0666fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeccb394-4413-411c-a93c-9fbec3f06537", "name": "network-vif-plugged", "status": "completed", "tag": "7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:23.617357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-bdaa6936-19e6-4d67-b697-f1641e5f3cf8 req-d835dd98-662d-4f86-b691-a7ebc0666fb9 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:23.617804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-bdaa6936-19e6-4d67-b697-f1641e5f3cf8 req-d835dd98-662d-4f86-b691-a7ebc0666fb9 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:23.634687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-bdaa6936-19e6-4d67-b697-f1641e5f3cf8 req-d835dd98-662d-4f86-b691-a7ebc0666fb9 service nova] Creating event network-vif-plugged:7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa for instance aeccb394-4413-411c-a93c-9fbec3f06537 on hv-cinder-81966 May 26 13:51:23.639546 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-bdaa6936-19e6-4d67-b697-f1641e5f3cf8 req-d835dd98-662d-4f86-b691-a7ebc0666fb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034845 May 26 13:51:23.640278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 417/816] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:24.043034 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:24.043680 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:24.046302 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=10 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:24.053775 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:24.054262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:24.055036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:24.055470 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:24.181872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-828633fb-c0fd-4b77-a4bb-329f59fabf5e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:24.182604 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-828633fb-c0fd-4b77-a4bb-329f59fabf5e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:24.191092 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-828633fb-c0fd-4b77-a4bb-329f59fabf5e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:24.191549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-828633fb-c0fd-4b77-a4bb-329f59fabf5e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:24.192390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-828633fb-c0fd-4b77-a4bb-329f59fabf5e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:24.194072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-828633fb-c0fd-4b77-a4bb-329f59fabf5e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:24.325684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:24.335684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:24.338013 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:24.341400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b6d46db5-ea83-4356-ba54-1c3350dcfc69 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.302680 May 26 13:51:24.342361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 400/817] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:24 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:24.347419 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1696a0be-79d3-4912-9809-36457534840a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:24.348554 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1696a0be-79d3-4912-9809-36457534840a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:24.356232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1696a0be-79d3-4912-9809-36457534840a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:24.357233 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1696a0be-79d3-4912-9809-36457534840a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:24.358163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1696a0be-79d3-4912-9809-36457534840a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:24.358893 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1696a0be-79d3-4912-9809-36457534840a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:24.399536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1696a0be-79d3-4912-9809-36457534840a tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055837 May 26 13:51:24.400663 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 401/818] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:51:24 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:24.415356 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-828633fb-c0fd-4b77-a4bb-329f59fabf5e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:24.423515 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-828633fb-c0fd-4b77-a4bb-329f59fabf5e tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.246301 May 26 13:51:24.424765 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 418/819] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:24 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:25.360065 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:25.360688 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:25.368269 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:25.368794 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:25.369587 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:25.370024 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:25.411007 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c0e53d2e-549b-47a1-8e1c-d9640700155f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:25.412469 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c0e53d2e-549b-47a1-8e1c-d9640700155f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:25.418979 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0e53d2e-549b-47a1-8e1c-d9640700155f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:25.419428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0e53d2e-549b-47a1-8e1c-d9640700155f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:25.420203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0e53d2e-549b-47a1-8e1c-d9640700155f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:25.420673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c0e53d2e-549b-47a1-8e1c-d9640700155f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:25.451618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c0e53d2e-549b-47a1-8e1c-d9640700155f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044426 May 26 13:51:25.452802 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 419/820] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:51:25 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 13:51:25.458442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f3c010a3-8c05-4c01-bb3f-c33aff5cce1c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:25.459325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f3c010a3-8c05-4c01-bb3f-c33aff5cce1c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:25.465312 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f3c010a3-8c05-4c01-bb3f-c33aff5cce1c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:25.465888 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f3c010a3-8c05-4c01-bb3f-c33aff5cce1c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:25.466723 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f3c010a3-8c05-4c01-bb3f-c33aff5cce1c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:25.467371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f3c010a3-8c05-4c01-bb3f-c33aff5cce1c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:25.509441 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:25.518310 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:25.519814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:25.521070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b0951b43-50b8-4eba-8de4-1d33cbf285e1 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.164846 May 26 13:51:25.521857 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 402/821] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:25 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:25.526340 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:25.526826 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:25.533069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:25.533520 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:25.534297 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:25.534728 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:25.622892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f3c010a3-8c05-4c01-bb3f-c33aff5cce1c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:25.632012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] HTTP exception thrown: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 is not attached to volume ae5100ea-6775-46be-b751-4781f37aa0b5 May 26 13:51:25.633135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f3c010a3-8c05-4c01-bb3f-c33aff5cce1c tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1578 microversion: 2.1 time: 0.178608 May 26 13:51:25.636766 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 420/822] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:25 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Request method failure captured: May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments/ae5100ea-6775-46be-b751-4781f37aa0b5 HTTP/1.1 May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4S0w11V3cNZgawHnl2pFcvX2U--f2Y1I8Gn79pN_f2NTNCFq3Pfv2Mwa3gh6Cg3p2MFPx4abGo6yllAEobJD4oytEQIC_Bv2gu09jqOtTjzMUl5GwLov1EmnEgU45fRYI55OLzChFJiGJyVdb4bTZzl0CDkDugMjOGoNPevSaA7iZA May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: c70c0ab9b5134d0781dea0e0abc02ac8 May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-TestMinimumBasicScenario-1780940749 May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:51:25.642665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c70c0ab9b5134d0781dea0e0abc02ac8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c70c0ab9b5134d0781dea0e0abc02ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c70c0ab9b5134d0781dea0e0abc02ac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c70c0ab9b5134d0781dea0e0abc02ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-TestMinimumBasicScenario-1780940749 May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: c70c0ab9b5134d0781dea0e0abc02ac8 May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1780940749 May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-TestMinimumBasicScenario-1780940749-project May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 5b0a34631db94d1d9fd5e865de5b9156 May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-TestMinimumBasicScenario-1780940749-project May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:51:25.644707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 is not attached to volume ae5100ea-6775-46be-b751-4781f37aa0b5 May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'server_id': '39ad193e-1516-41cd-8603-74830f1c6fc7', 'id': 'ae5100ea-6775-46be-b751-4781f37aa0b5'} May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ae5100ea-6775-46be-b751-4781f37aa0b5. May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:51:25.645485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 is not attached to volume ae5100ea-6775-46be-b751-4781f37aa0b5 May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 is not attached to volume ae5100ea-6775-46be-b751-4781f37aa0b5 May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:25.646731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Returning 404 to user: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 is not attached to volume ae5100ea-6775-46be-b751-4781f37aa0b5 {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:51:25.647620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d4f89270-bf47-4740-ad48-bf188adf934b tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments/ae5100ea-6775-46be-b751-4781f37aa0b5" status: 404 len: 154 microversion: 2.1 time: 0.122394 May 26 13:51:25.647620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 403/823] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 13:51:25 2022] DELETE /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7/os-volume_attachments/ae5100ea-6775-46be-b751-4781f37aa0b5 => generated 154 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:51:26.540163 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:26.540821 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:26.547249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:26.547695 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:26.548500 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:26.548928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:26.653826 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3286f573-8636-4d95-b2a1-ea5f5529f9c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:26.654950 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3286f573-8636-4d95-b2a1-ea5f5529f9c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:26.662628 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3286f573-8636-4d95-b2a1-ea5f5529f9c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:26.663072 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3286f573-8636-4d95-b2a1-ea5f5529f9c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:26.663848 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3286f573-8636-4d95-b2a1-ea5f5529f9c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:26.664284 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3286f573-8636-4d95-b2a1-ea5f5529f9c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:26.685332 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:26.693290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:26.695190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:26.696429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f243d0a6-dda3-41d9-8b55-fbc213bdad0b tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1408 microversion: 2.20 time: 0.160872 May 26 13:51:26.696998 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 421/824] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:26 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:26.796018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e635efa2-6c06-44e7-9716-b24daa2e4850 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:26.796482 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e635efa2-6c06-44e7-9716-b24daa2e4850 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:26.800376 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3286f573-8636-4d95-b2a1-ea5f5529f9c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:26.802548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e635efa2-6c06-44e7-9716-b24daa2e4850 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:26.803008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e635efa2-6c06-44e7-9716-b24daa2e4850 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:26.803789 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e635efa2-6c06-44e7-9716-b24daa2e4850 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:26.804234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e635efa2-6c06-44e7-9716-b24daa2e4850 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:26.808898 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3286f573-8636-4d95-b2a1-ea5f5529f9c7 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1565 microversion: 2.1 time: 0.158756 May 26 13:51:26.809496 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 404/825] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:26 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:51:26.829686 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e635efa2-6c06-44e7-9716-b24daa2e4850 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:51:26.877328 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:26.913396 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e635efa2-6c06-44e7-9716-b24daa2e4850 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "DELETE /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 204 len: 0 microversion: 2.1 time: 0.121033 May 26 13:51:26.913988 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 422/826] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:51:26 2022] DELETE /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 13:51:26.924496 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f944a6f0-f212-48cf-a574-844a2419a4e1 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:26.925134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f944a6f0-f212-48cf-a574-844a2419a4e1 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:26.932032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f944a6f0-f212-48cf-a574-844a2419a4e1 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:26.932524 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f944a6f0-f212-48cf-a574-844a2419a4e1 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:26.933296 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f944a6f0-f212-48cf-a574-844a2419a4e1 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:26.933738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f944a6f0-f212-48cf-a574-844a2419a4e1 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:27.074656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f944a6f0-f212-48cf-a574-844a2419a4e1 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:27.082121 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f944a6f0-f212-48cf-a574-844a2419a4e1 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1552 microversion: 2.1 time: 0.161513 May 26 13:51:27.082671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 405/827] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:26 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:27.608156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-862a4d83-89ac-4485-8aeb-f9146aaaf8c8 req-004f42a4-4469-442a-9bc0-618cbf59624f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb5af8d-022d-4708-aca9-49d3db482dcd", "name": "network-vif-plugged", "status": "completed", "tag": "04d681e3-ceab-4cf6-876e-aec8b3942d85"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:27.617296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-862a4d83-89ac-4485-8aeb-f9146aaaf8c8 req-004f42a4-4469-442a-9bc0-618cbf59624f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:27.617741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-862a4d83-89ac-4485-8aeb-f9146aaaf8c8 req-004f42a4-4469-442a-9bc0-618cbf59624f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:27.631141 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-862a4d83-89ac-4485-8aeb-f9146aaaf8c8 req-004f42a4-4469-442a-9bc0-618cbf59624f service nova] Creating event network-vif-plugged:04d681e3-ceab-4cf6-876e-aec8b3942d85 for instance 2fb5af8d-022d-4708-aca9-49d3db482dcd on hv-cinder-81966 May 26 13:51:27.635974 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-862a4d83-89ac-4485-8aeb-f9146aaaf8c8 req-004f42a4-4469-442a-9bc0-618cbf59624f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032126 May 26 13:51:27.636619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 423/828] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:51:27.715418 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:27.716000 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:27.722963 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:27.723403 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:27.724447 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:27.724903 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:27.870807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:27.879210 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:27.881469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:27.882651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8b8b1e30-c33a-43b1-aacd-e4d86970d963 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1601 microversion: 2.20 time: 0.171284 May 26 13:51:27.883218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 406/829] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:51:27 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1601 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:51:27.903755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4aae7111-f62b-44bf-947c-a0939c20c503 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:27.904363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4aae7111-f62b-44bf-947c-a0939c20c503 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:27.910711 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4aae7111-f62b-44bf-947c-a0939c20c503 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:27.911183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4aae7111-f62b-44bf-947c-a0939c20c503 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:27.911952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4aae7111-f62b-44bf-947c-a0939c20c503 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:27.912425 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4aae7111-f62b-44bf-947c-a0939c20c503 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:28.002204 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4aae7111-f62b-44bf-947c-a0939c20c503 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102749 May 26 13:51:28.002804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 424/830] 10.222.0.16 () {60 vars in 1315 bytes} [Thu May 26 13:51:27 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:51:28.099723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-027c79b9-c6e0-4918-8ba6-a7b7950cf2c2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:28.100588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-027c79b9-c6e0-4918-8ba6-a7b7950cf2c2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:28.106966 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-027c79b9-c6e0-4918-8ba6-a7b7950cf2c2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:28.107504 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-027c79b9-c6e0-4918-8ba6-a7b7950cf2c2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:28.108383 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-027c79b9-c6e0-4918-8ba6-a7b7950cf2c2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:28.108890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-027c79b9-c6e0-4918-8ba6-a7b7950cf2c2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:28.394228 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-027c79b9-c6e0-4918-8ba6-a7b7950cf2c2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:28.402939 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-027c79b9-c6e0-4918-8ba6-a7b7950cf2c2 tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1552 microversion: 2.1 time: 0.307384 May 26 13:51:28.403716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 407/831] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:28 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1552 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:29.110210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-84e01036-3e82-4fdb-838c-cf00991bc38f req-a1fd738e-32c4-4295-849e-12bbec189e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aeccb394-4413-411c-a93c-9fbec3f06537", "tag": "7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:29.119319 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-84e01036-3e82-4fdb-838c-cf00991bc38f req-a1fd738e-32c4-4295-849e-12bbec189e43 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:29.119767 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-84e01036-3e82-4fdb-838c-cf00991bc38f req-a1fd738e-32c4-4295-849e-12bbec189e43 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:29.133090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-84e01036-3e82-4fdb-838c-cf00991bc38f req-a1fd738e-32c4-4295-849e-12bbec189e43 service nova] Creating event network-changed:7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa for instance aeccb394-4413-411c-a93c-9fbec3f06537 on hv-cinder-81966 May 26 13:51:29.138214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-84e01036-3e82-4fdb-838c-cf00991bc38f req-a1fd738e-32c4-4295-849e-12bbec189e43 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033045 May 26 13:51:29.138815 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 425/832] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:29.422764 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8b12f241-d55e-4468-a10a-f54cd6fd890f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:29.424036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8b12f241-d55e-4468-a10a-f54cd6fd890f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:29.434075 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b12f241-d55e-4468-a10a-f54cd6fd890f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:29.434531 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b12f241-d55e-4468-a10a-f54cd6fd890f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:29.435329 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b12f241-d55e-4468-a10a-f54cd6fd890f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:29.436111 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8b12f241-d55e-4468-a10a-f54cd6fd890f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:30.000338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8b12f241-d55e-4468-a10a-f54cd6fd890f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b0a34631db94d1d9fd5e865de5b9156', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70c0ab9b5134d0781dea0e0abc02ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:30.006287 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:30.009650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8b12f241-d55e-4468-a10a-f54cd6fd890f tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 200 len: 1552 microversion: 2.1 time: 0.592530 May 26 13:51:30.014040 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 408/833] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:29 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 1552 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:31.028137 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:31.028757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] [instance: 39ad193e-1516-41cd-8603-74830f1c6fc7] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:31.030685 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:31.036496 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:31.036954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:31.037757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:31.038195 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:31.053698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] HTTP exception thrown: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 could not be found. May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Request method failure captured: May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 HTTP/1.1 May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4S0w11V3cNZgawHnl2pFcvX2U--f2Y1I8Gn79pN_f2NTNCFq3Pfv2Mwa3gh6Cg3p2MFPx4abGo6yllAEobJD4oytEQIC_Bv2gu09jqOtTjzMUl5GwLov1EmnEgU45fRYI55OLzChFJiGJyVdb4bTZzl0CDkDugMjOGoNPevSaA7iZA May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: c70c0ab9b5134d0781dea0e0abc02ac8 May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-TestMinimumBasicScenario-1780940749 May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:51:31.055357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c70c0ab9b5134d0781dea0e0abc02ac8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c70c0ab9b5134d0781dea0e0abc02ac8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c70c0ab9b5134d0781dea0e0abc02ac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c70c0ab9b5134d0781dea0e0abc02ac8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-TestMinimumBasicScenario-1780940749 May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: c70c0ab9b5134d0781dea0e0abc02ac8 May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1780940749 May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-TestMinimumBasicScenario-1780940749-project May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: 5b0a34631db94d1d9fd5e865de5b9156 May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-TestMinimumBasicScenario-1780940749-project May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 could not be found. May 26 13:51:31.057783 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '39ad193e-1516-41cd-8603-74830f1c6fc7'} May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 could not be found. May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:51:31.059119 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 could not be found. May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 could not be found. May 26 13:51:31.061429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:51:31.063905 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Returning 404 to user: Instance 39ad193e-1516-41cd-8603-74830f1c6fc7 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:51:31.063905 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6b721102-47c4-4915-91b2-4e7953d1edaa tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7" status: 404 len: 111 microversion: 2.1 time: 0.033660 May 26 13:51:31.063905 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 426/834] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:31 2022] GET /compute/v2.1/servers/39ad193e-1516-41cd-8603-74830f1c6fc7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:51:31.066133 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-84fb59a7-0a74-4ff4-99b5-0c712b22b8ab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] Calling method '.version_select at 0x7f07e040dd30>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:31.073193 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:31.087884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-84fb59a7-0a74-4ff4-99b5-0c712b22b8ab tempest-TestMinimumBasicScenario-1780940749 tempest-TestMinimumBasicScenario-1780940749-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1245478232" status: 202 len: 0 microversion: 2.1 time: 0.025899 May 26 13:51:31.088501 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 409/835] 10.222.0.16 () {58 vars in 1271 bytes} [Thu May 26 13:51:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1245478232 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:51:31.153253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-e62598be-cebe-42fa-bfcc-6a354ccbb61d req-b49f2ff6-40f6-47d5-9472-e532b9d889d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ad193e-1516-41cd-8603-74830f1c6fc7", "name": "network-vif-deleted", "tag": "e0662874-78ce-4387-a824-8ab106baa767"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:31.161594 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e62598be-cebe-42fa-bfcc-6a354ccbb61d req-b49f2ff6-40f6-47d5-9472-e532b9d889d6 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:31.162443 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e62598be-cebe-42fa-bfcc-6a354ccbb61d req-b49f2ff6-40f6-47d5-9472-e532b9d889d6 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:31.173752 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-e62598be-cebe-42fa-bfcc-6a354ccbb61d req-b49f2ff6-40f6-47d5-9472-e532b9d889d6 service nova] Creating event network-vif-deleted:e0662874-78ce-4387-a824-8ab106baa767 for instance 39ad193e-1516-41cd-8603-74830f1c6fc7 on hv-cinder-81966 May 26 13:51:31.179055 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-e62598be-cebe-42fa-bfcc-6a354ccbb61d req-b49f2ff6-40f6-47d5-9472-e532b9d889d6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029601 May 26 13:51:31.179645 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 427/836] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:51:42.865147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dc3ce2e5-a4f2-40fd-b77a-6d9dbe505a57 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:42.865147 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dc3ce2e5-a4f2-40fd-b77a-6d9dbe505a57 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:42.871384 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc3ce2e5-a4f2-40fd-b77a-6d9dbe505a57 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:42.871837 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc3ce2e5-a4f2-40fd-b77a-6d9dbe505a57 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:42.872660 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc3ce2e5-a4f2-40fd-b77a-6d9dbe505a57 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:42.873097 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-dc3ce2e5-a4f2-40fd-b77a-6d9dbe505a57 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:42.958603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-dc3ce2e5-a4f2-40fd-b77a-6d9dbe505a57 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lazy-loading 'services' on Instance uuid eda2ad3f-020c-4f84-8456-bd57ac8994a1 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:51:43.034652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dc3ce2e5-a4f2-40fd-b77a-6d9dbe505a57 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments/13fcc238-c5ac-448e-acdc-fe75336fffeb" status: 202 len: 0 microversion: 2.1 time: 0.175395 May 26 13:51:43.035242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 410/837] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 13:51:42 2022] DELETE /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments/13fcc238-c5ac-448e-acdc-fe75336fffeb => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:51:43.041538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:43.042280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=13,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:51:43.046694 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e4ab8a5a-751f-4c26-9a2a-98180b530ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:43.047942 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e4ab8a5a-751f-4c26-9a2a-98180b530ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:43.057428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4ab8a5a-751f-4c26-9a2a-98180b530ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:43.057798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4ab8a5a-751f-4c26-9a2a-98180b530ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:43.058595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4ab8a5a-751f-4c26-9a2a-98180b530ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:43.059020 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4ab8a5a-751f-4c26-9a2a-98180b530ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:43.090971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e4ab8a5a-751f-4c26-9a2a-98180b530ed1 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050980 May 26 13:51:43.091358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 428/838] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:51:43 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:51:44.104644 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06cd1ce1-291a-4212-a513-01d5f89029cf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:44.105726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06cd1ce1-291a-4212-a513-01d5f89029cf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:44.112558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06cd1ce1-291a-4212-a513-01d5f89029cf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:44.113055 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06cd1ce1-291a-4212-a513-01d5f89029cf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:44.114430 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06cd1ce1-291a-4212-a513-01d5f89029cf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:44.115023 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06cd1ce1-291a-4212-a513-01d5f89029cf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:44.147080 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06cd1ce1-291a-4212-a513-01d5f89029cf tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047536 May 26 13:51:44.147657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 411/839] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:51:44 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:51:44.226111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-32a92331-da52-4091-9164-2b7fabc3210a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:44.226679 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-32a92331-da52-4091-9164-2b7fabc3210a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:44.233156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32a92331-da52-4091-9164-2b7fabc3210a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:44.233613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32a92331-da52-4091-9164-2b7fabc3210a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:44.234384 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32a92331-da52-4091-9164-2b7fabc3210a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:44.234816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32a92331-da52-4091-9164-2b7fabc3210a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:44.260985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-32a92331-da52-4091-9164-2b7fabc3210a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:51:44.349297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-32a92331-da52-4091-9164-2b7fabc3210a tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 204 len: 0 microversion: 2.1 time: 0.126573 May 26 13:51:44.349797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 429/840] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:51:44 2022] DELETE /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:51:44.362983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2f2962b6-0565-43e9-b2e3-7046c6d714a8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:44.364617 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2f2962b6-0565-43e9-b2e3-7046c6d714a8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:44.373842 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f2962b6-0565-43e9-b2e3-7046c6d714a8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:44.374829 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f2962b6-0565-43e9-b2e3-7046c6d714a8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:44.375712 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f2962b6-0565-43e9-b2e3-7046c6d714a8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:44.376388 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f2962b6-0565-43e9-b2e3-7046c6d714a8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:44.527995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2f2962b6-0565-43e9-b2e3-7046c6d714a8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:44.536782 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2f2962b6-0565-43e9-b2e3-7046c6d714a8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1688 microversion: 2.1 time: 0.179311 May 26 13:51:44.537530 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 412/841] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:44 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:45.556053 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d99f2568-2d2a-41b9-b7a2-77ecad5fe9e0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:45.556801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d99f2568-2d2a-41b9-b7a2-77ecad5fe9e0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:45.563728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d99f2568-2d2a-41b9-b7a2-77ecad5fe9e0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:45.564174 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d99f2568-2d2a-41b9-b7a2-77ecad5fe9e0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:45.564990 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d99f2568-2d2a-41b9-b7a2-77ecad5fe9e0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:45.565424 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d99f2568-2d2a-41b9-b7a2-77ecad5fe9e0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:45.718305 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d99f2568-2d2a-41b9-b7a2-77ecad5fe9e0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:45.728273 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d99f2568-2d2a-41b9-b7a2-77ecad5fe9e0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1688 microversion: 2.1 time: 0.177226 May 26 13:51:45.728895 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 430/842] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:45 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:46.746028 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-164feac8-185f-49ca-8a7a-cfb025ca5b32 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:46.746587 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-164feac8-185f-49ca-8a7a-cfb025ca5b32 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:46.753941 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-164feac8-185f-49ca-8a7a-cfb025ca5b32 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:46.754990 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-164feac8-185f-49ca-8a7a-cfb025ca5b32 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:46.755790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-164feac8-185f-49ca-8a7a-cfb025ca5b32 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:46.756237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-164feac8-185f-49ca-8a7a-cfb025ca5b32 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:46.894725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-164feac8-185f-49ca-8a7a-cfb025ca5b32 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:46.910178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-164feac8-185f-49ca-8a7a-cfb025ca5b32 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1688 microversion: 2.1 time: 0.168659 May 26 13:51:46.910817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 413/843] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:46 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:47.927387 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-efa1d52e-65a3-4170-80a3-129636b3189e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:47.928004 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-efa1d52e-65a3-4170-80a3-129636b3189e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:47.934710 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-efa1d52e-65a3-4170-80a3-129636b3189e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:47.935164 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-efa1d52e-65a3-4170-80a3-129636b3189e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:47.935944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-efa1d52e-65a3-4170-80a3-129636b3189e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:47.936418 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-efa1d52e-65a3-4170-80a3-129636b3189e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:48.076819 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-efa1d52e-65a3-4170-80a3-129636b3189e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:48.085433 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-efa1d52e-65a3-4170-80a3-129636b3189e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1688 microversion: 2.1 time: 0.162067 May 26 13:51:48.086090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 431/844] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:47 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:49.107310 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-89a0d9c1-1382-43e3-bf8d-a528ebe0952e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:49.108294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-89a0d9c1-1382-43e3-bf8d-a528ebe0952e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:49.118989 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89a0d9c1-1382-43e3-bf8d-a528ebe0952e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:49.119523 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89a0d9c1-1382-43e3-bf8d-a528ebe0952e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:49.120748 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89a0d9c1-1382-43e3-bf8d-a528ebe0952e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:49.124466 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-89a0d9c1-1382-43e3-bf8d-a528ebe0952e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:49.251700 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-89a0d9c1-1382-43e3-bf8d-a528ebe0952e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:49.261331 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-89a0d9c1-1382-43e3-bf8d-a528ebe0952e tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 200 len: 1621 microversion: 2.1 time: 0.161345 May 26 13:51:49.261919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 414/845] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:49 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 1621 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:49.551824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-0ec0e538-cac4-4c52-a96d-0a951e0cc026 req-f5fc9417-4138-49f7-bf93-7bd5cc4ea299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda2ad3f-020c-4f84-8456-bd57ac8994a1", "name": "network-vif-deleted", "tag": "8a479ff1-a45a-48a2-afb3-db2272655b74"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:49.561263 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-0ec0e538-cac4-4c52-a96d-0a951e0cc026 req-f5fc9417-4138-49f7-bf93-7bd5cc4ea299 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:49.561861 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-0ec0e538-cac4-4c52-a96d-0a951e0cc026 req-f5fc9417-4138-49f7-bf93-7bd5cc4ea299 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:49.575048 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-0ec0e538-cac4-4c52-a96d-0a951e0cc026 req-f5fc9417-4138-49f7-bf93-7bd5cc4ea299 service nova] Creating event network-vif-deleted:8a479ff1-a45a-48a2-afb3-db2272655b74 for instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 on hv-cinder-81966 May 26 13:51:49.582608 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-0ec0e538-cac4-4c52-a96d-0a951e0cc026 req-f5fc9417-4138-49f7-bf93-7bd5cc4ea299 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035502 May 26 13:51:49.584523 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 432/846] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:51:50.282462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:50.283597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: eda2ad3f-020c-4f84-8456-bd57ac8994a1] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:50.293296 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:50.293870 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:50.294860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:50.295395 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:50.311894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] HTTP exception thrown: Instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 could not be found. May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Request method failure captured: May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 HTTP/1.1 May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RbRUWuARFGkE_5vp-aUVCmAd1sOs3n7Bajq1lOXpZEUZd0FBaykhrcUrub2qPRQYXLnHjACEWP4w_Z4B9q9yTmJ2gk5KWB4cACUVTYnFQTvxh3ybkOd-tbUcxA__Sdrz4Pf61dXEV6D8lKHhkmLUd_V7SNHeFyJJ5tDhiruopzKPU May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:51:50.313698 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_667a2ccd9c9045879b4b87e156997161", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: dd8055e46e6149d3897fb88af0b19d39 May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 could not be found. May 26 13:51:50.315656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'eda2ad3f-020c-4f84-8456-bd57ac8994a1'} May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 could not be found. May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:51:50.316763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 could not be found. May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 could not be found. May 26 13:51:50.318699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:50.320412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Returning 404 to user: Instance eda2ad3f-020c-4f84-8456-bd57ac8994a1 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:51:50.320412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a96c772-adce-4236-96bf-7bc28f19f028 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1" status: 404 len: 111 microversion: 2.1 time: 0.038483 May 26 13:51:50.320412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 415/847] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:50 2022] GET /compute/v2.1/servers/eda2ad3f-020c-4f84-8456-bd57ac8994a1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:51:50.326637 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-24239d13-fdf2-4790-87ae-f4769b85bc53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '.version_select at 0x7f07e04c4280>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:50.349562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-24239d13-fdf2-4790-87ae-f4769b85bc53 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661069062" status: 202 len: 0 microversion: 2.1 time: 0.027082 May 26 13:51:50.350169 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 433/848] 10.222.0.16 () {58 vars in 1220 bytes} [Thu May 26 13:51:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661069062 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:51:53.416609 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-efe1a806-c57a-48b0-90b9-a3183584b94f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:53.417288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-efe1a806-c57a-48b0-90b9-a3183584b94f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:53.423995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efe1a806-c57a-48b0-90b9-a3183584b94f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:53.424503 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efe1a806-c57a-48b0-90b9-a3183584b94f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:53.425305 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efe1a806-c57a-48b0-90b9-a3183584b94f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:53.426289 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-efe1a806-c57a-48b0-90b9-a3183584b94f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:53.454037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-efe1a806-c57a-48b0-90b9-a3183584b94f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:51:53.542564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-efe1a806-c57a-48b0-90b9-a3183584b94f tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 204 len: 0 microversion: 2.1 time: 0.130023 May 26 13:51:53.543374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 416/849] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:51:53 2022] DELETE /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:51:53.553375 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-da3305a4-26b8-4300-abd7-9989677526a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:53.554191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-da3305a4-26b8-4300-abd7-9989677526a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:53.564354 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-da3305a4-26b8-4300-abd7-9989677526a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:53.564807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-da3305a4-26b8-4300-abd7-9989677526a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:53.565600 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-da3305a4-26b8-4300-abd7-9989677526a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:53.566037 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-da3305a4-26b8-4300-abd7-9989677526a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:53.722741 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-da3305a4-26b8-4300-abd7-9989677526a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:53.730713 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-da3305a4-26b8-4300-abd7-9989677526a0 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1505 microversion: 2.1 time: 0.181794 May 26 13:51:53.731307 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 434/850] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:53 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:54.749420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c7d2fec-4fd3-433d-897d-bf94557ccf87 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:54.750124 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c7d2fec-4fd3-433d-897d-bf94557ccf87 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:54.758509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c7d2fec-4fd3-433d-897d-bf94557ccf87 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:54.758817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c7d2fec-4fd3-433d-897d-bf94557ccf87 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:54.759633 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c7d2fec-4fd3-433d-897d-bf94557ccf87 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:54.760071 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c7d2fec-4fd3-433d-897d-bf94557ccf87 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:55.024087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5c7d2fec-4fd3-433d-897d-bf94557ccf87 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:55.036010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c7d2fec-4fd3-433d-897d-bf94557ccf87 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1505 microversion: 2.1 time: 0.290590 May 26 13:51:55.036933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 417/851] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:54 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:55.419275 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-89f490d0-a03c-4fba-9401-4a0028d30430 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:55.420271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-89f490d0-a03c-4fba-9401-4a0028d30430 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:55.427516 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-89f490d0-a03c-4fba-9401-4a0028d30430 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:55.427971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-89f490d0-a03c-4fba-9401-4a0028d30430 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:55.428799 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-89f490d0-a03c-4fba-9401-4a0028d30430 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:55.429244 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-89f490d0-a03c-4fba-9401-4a0028d30430 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:55.463358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-89f490d0-a03c-4fba-9401-4a0028d30430 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048306 May 26 13:51:55.464052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 435/852] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:51:55 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 13:51:55.524571 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-aa169364-5884-42fe-bcc1-833ad5f6797c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:55.525757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-aa169364-5884-42fe-bcc1-833ad5f6797c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:55.532830 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa169364-5884-42fe-bcc1-833ad5f6797c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:55.533822 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa169364-5884-42fe-bcc1-833ad5f6797c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:55.534728 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa169364-5884-42fe-bcc1-833ad5f6797c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:55.535580 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa169364-5884-42fe-bcc1-833ad5f6797c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:55.565600 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-aa169364-5884-42fe-bcc1-833ad5f6797c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:51:55.662824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-aa169364-5884-42fe-bcc1-833ad5f6797c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 204 len: 0 microversion: 2.1 time: 0.141980 May 26 13:51:55.663697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 418/853] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:51:55 2022] DELETE /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:51:55.677775 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d8422551-3e41-40c9-8d79-6601c7b5514e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:55.679494 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d8422551-3e41-40c9-8d79-6601c7b5514e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:55.690749 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d8422551-3e41-40c9-8d79-6601c7b5514e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:55.692068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d8422551-3e41-40c9-8d79-6601c7b5514e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:55.693689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d8422551-3e41-40c9-8d79-6601c7b5514e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:55.694386 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d8422551-3e41-40c9-8d79-6601c7b5514e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:55.698772 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-f46ba7f4-91b0-454c-b0ae-0ff5538858c6 req-dff53f6d-e33f-4534-960d-bff252754402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b75f8bc8-637f-444e-b3f2-5f5fa9620cf9", "name": "network-vif-deleted", "tag": "22ba30dc-f3ef-4d8d-aa67-0fbf99c6a3aa"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:55.711166 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f46ba7f4-91b0-454c-b0ae-0ff5538858c6 req-dff53f6d-e33f-4534-960d-bff252754402 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:55.711944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f46ba7f4-91b0-454c-b0ae-0ff5538858c6 req-dff53f6d-e33f-4534-960d-bff252754402 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:55.725650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-f46ba7f4-91b0-454c-b0ae-0ff5538858c6 req-dff53f6d-e33f-4534-960d-bff252754402 service nova] Creating event network-vif-deleted:22ba30dc-f3ef-4d8d-aa67-0fbf99c6a3aa for instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 on hv-cinder-81966 May 26 13:51:55.731408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-f46ba7f4-91b0-454c-b0ae-0ff5538858c6 req-dff53f6d-e33f-4534-960d-bff252754402 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041519 May 26 13:51:55.732031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 419/854] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:51:55.861072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d8422551-3e41-40c9-8d79-6601c7b5514e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:55.869502 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d8422551-3e41-40c9-8d79-6601c7b5514e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1673 microversion: 2.1 time: 0.200751 May 26 13:51:55.870008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 436/855] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:55 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1673 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:56.058319 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1b36524c-6aad-49e6-891a-df2eedd3cc67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:56.059179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1b36524c-6aad-49e6-891a-df2eedd3cc67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:56.066187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b36524c-6aad-49e6-891a-df2eedd3cc67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:56.066874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b36524c-6aad-49e6-891a-df2eedd3cc67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:56.067784 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b36524c-6aad-49e6-891a-df2eedd3cc67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:56.068526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b36524c-6aad-49e6-891a-df2eedd3cc67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:56.145689 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1b36524c-6aad-49e6-891a-df2eedd3cc67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:56.153999 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1b36524c-6aad-49e6-891a-df2eedd3cc67 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 200 len: 1463 microversion: 2.1 time: 0.100379 May 26 13:51:56.154583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 420/856] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:56 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 1463 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:56.886755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-65861082-a735-4c75-9151-899214d906cc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:56.887369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-65861082-a735-4c75-9151-899214d906cc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:56.894206 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-65861082-a735-4c75-9151-899214d906cc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:56.894738 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-65861082-a735-4c75-9151-899214d906cc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:56.895526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-65861082-a735-4c75-9151-899214d906cc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:56.895994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-65861082-a735-4c75-9151-899214d906cc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:57.034050 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-65861082-a735-4c75-9151-899214d906cc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:57.042743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-65861082-a735-4c75-9151-899214d906cc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1673 microversion: 2.1 time: 0.159722 May 26 13:51:57.043303 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 437/857] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:56 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:57.171350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:57.172145 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: b75f8bc8-637f-444e-b3f2-5f5fa9620cf9] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:57.182077 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:57.182992 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:57.184478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:57.185299 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:57.204916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] HTTP exception thrown: Instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 could not be found. May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Request method failure captured: May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 HTTP/1.1 May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RbRUWuARFGkE_5vp-aUVCmAd1sOs3n7Bajq1lOXpZEUZd0FBaykhrcUrub2qPRQYXLnHjACEWP4w_Z4B9q9yTmJ2gk5KWB4cACUVTYnFQTvxh3ybkOd-tbUcxA__Sdrz4Pf61dXEV6D8lKHhkmLUd_V7SNHeFyJJ5tDhiruopzKPU May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:51:57.206969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_667a2ccd9c9045879b4b87e156997161", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: dd8055e46e6149d3897fb88af0b19d39 May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 could not be found. May 26 13:51:57.208760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'b75f8bc8-637f-444e-b3f2-5f5fa9620cf9'} May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 could not be found. May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:51:57.209588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 could not be found. May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 could not be found. May 26 13:51:57.210878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:51:57.211925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Returning 404 to user: Instance b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:51:57.211925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f6418197-45ac-4d6b-8e72-4d5a89f4a2bd tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9" status: 404 len: 111 microversion: 2.1 time: 0.041166 May 26 13:51:57.211925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 421/858] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:57 2022] GET /compute/v2.1/servers/b75f8bc8-637f-444e-b3f2-5f5fa9620cf9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:51:57.217554 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d948b7c0-894a-4993-b166-290e1616bc49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:57.218055 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d948b7c0-894a-4993-b166-290e1616bc49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:57.225036 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d948b7c0-894a-4993-b166-290e1616bc49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:57.225487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d948b7c0-894a-4993-b166-290e1616bc49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:57.226297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d948b7c0-894a-4993-b166-290e1616bc49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:57.226733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d948b7c0-894a-4993-b166-290e1616bc49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:57.252765 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d948b7c0-894a-4993-b166-290e1616bc49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:51:57.339305 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d948b7c0-894a-4993-b166-290e1616bc49 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 204 len: 0 microversion: 2.1 time: 0.124588 May 26 13:51:57.340403 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 438/859] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:51:57 2022] DELETE /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:51:57.350649 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2eb8cd01-33fb-41e5-a1ed-ee2f59cc7804 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:57.351742 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2eb8cd01-33fb-41e5-a1ed-ee2f59cc7804 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:57.368081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2eb8cd01-33fb-41e5-a1ed-ee2f59cc7804 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:57.368512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2eb8cd01-33fb-41e5-a1ed-ee2f59cc7804 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:57.369306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2eb8cd01-33fb-41e5-a1ed-ee2f59cc7804 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:57.369781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2eb8cd01-33fb-41e5-a1ed-ee2f59cc7804 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:57.667469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2eb8cd01-33fb-41e5-a1ed-ee2f59cc7804 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:57.675366 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2eb8cd01-33fb-41e5-a1ed-ee2f59cc7804 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.329943 May 26 13:51:57.676631 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 422/860] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:57 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:58.061627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7d1c1be3-1f54-498b-a756-f4bb5650384d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:58.063763 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7d1c1be3-1f54-498b-a756-f4bb5650384d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:58.065778 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-e1fb3d1d-5099-4854-894e-6d16e67f0ad5 req-d9e114c2-2ab8-44fa-bc9b-71fce74b0790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84b45620-7dd5-4bb5-9da2-e48381d78256", "name": "network-vif-deleted", "tag": "fa68ed54-b95b-4bfd-afca-997df1610ee7"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:51:58.071324 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7d1c1be3-1f54-498b-a756-f4bb5650384d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:58.072111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7d1c1be3-1f54-498b-a756-f4bb5650384d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:58.072992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7d1c1be3-1f54-498b-a756-f4bb5650384d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:58.073662 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7d1c1be3-1f54-498b-a756-f4bb5650384d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:58.084581 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-e1fb3d1d-5099-4854-894e-6d16e67f0ad5 req-d9e114c2-2ab8-44fa-bc9b-71fce74b0790 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:58.085058 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-e1fb3d1d-5099-4854-894e-6d16e67f0ad5 req-d9e114c2-2ab8-44fa-bc9b-71fce74b0790 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:58.097013 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-e1fb3d1d-5099-4854-894e-6d16e67f0ad5 req-d9e114c2-2ab8-44fa-bc9b-71fce74b0790 service nova] Creating event network-vif-deleted:fa68ed54-b95b-4bfd-afca-997df1610ee7 for instance 84b45620-7dd5-4bb5-9da2-e48381d78256 on hv-cinder-81966 May 26 13:51:58.102845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-e1fb3d1d-5099-4854-894e-6d16e67f0ad5 req-d9e114c2-2ab8-44fa-bc9b-71fce74b0790 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040743 May 26 13:51:58.103680 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 423/861] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:51:58.145579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7d1c1be3-1f54-498b-a756-f4bb5650384d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:58.154322 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7d1c1be3-1f54-498b-a756-f4bb5650384d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1605 microversion: 2.1 time: 0.097329 May 26 13:51:58.155290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 439/862] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:58 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:58.695178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c2388fc1-db9d-4393-9366-914de669b052 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:58.695969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c2388fc1-db9d-4393-9366-914de669b052 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:58.702651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2388fc1-db9d-4393-9366-914de669b052 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:58.703174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2388fc1-db9d-4393-9366-914de669b052 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:58.703895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2388fc1-db9d-4393-9366-914de669b052 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:58.704357 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c2388fc1-db9d-4393-9366-914de669b052 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:58.858259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c2388fc1-db9d-4393-9366-914de669b052 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:58.866761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c2388fc1-db9d-4393-9366-914de669b052 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.176712 May 26 13:51:58.867308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 424/863] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:58 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:59.171914 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ccad1eb0-37c8-4a4e-bb14-07919b909647 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:59.172564 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ccad1eb0-37c8-4a4e-bb14-07919b909647 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:59.178846 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ccad1eb0-37c8-4a4e-bb14-07919b909647 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:59.179302 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ccad1eb0-37c8-4a4e-bb14-07919b909647 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:59.180075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ccad1eb0-37c8-4a4e-bb14-07919b909647 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:59.180547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ccad1eb0-37c8-4a4e-bb14-07919b909647 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:59.245183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ccad1eb0-37c8-4a4e-bb14-07919b909647 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:51:59.253069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ccad1eb0-37c8-4a4e-bb14-07919b909647 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 200 len: 1321 microversion: 2.1 time: 0.084867 May 26 13:51:59.254375 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 440/864] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:59 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 1321 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:51:59.885021 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-49e7f966-1a0d-4c86-8ab1-baeca50997d8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:51:59.885558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-49e7f966-1a0d-4c86-8ab1-baeca50997d8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:51:59.891982 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49e7f966-1a0d-4c86-8ab1-baeca50997d8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:59.892520 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49e7f966-1a0d-4c86-8ab1-baeca50997d8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:59.893297 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49e7f966-1a0d-4c86-8ab1-baeca50997d8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:51:59.893734 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-49e7f966-1a0d-4c86-8ab1-baeca50997d8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:51:59.897902 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:00.111117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-49e7f966-1a0d-4c86-8ab1-baeca50997d8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd8055e46e6149d3897fb88af0b19d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '667a2ccd9c9045879b4b87e156997161', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:00.118991 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-49e7f966-1a0d-4c86-8ab1-baeca50997d8 tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 200 len: 1519 microversion: 2.1 time: 0.237898 May 26 13:52:00.121084 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 425/865] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:51:59 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:00.272960 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:00.273516 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:00.281193 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:00.281906 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:00.282871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:00.283989 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:00.302405 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] HTTP exception thrown: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Request method failure captured: May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 HTTP/1.1 May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RbQuwSoyyhHLe1AaWM79ujMzSRxmgiVjqHvbcdP0M9qEu0WtYA9ynH0V4Xygc-JTgl0iV0QQUT21kLF-1i6CWm2BalRTQdaq6oVIEh8lpJ1kMPKs1EQgfIOd7KplEi8K_rdHqoubcf-0uZPgE5YUhIaITva-T3GRn67MwyIvskeFw May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 2007395425194750a87edd6c0da44e66 May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:52:00.304210 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2007395425194750a87edd6c0da44e66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2007395425194750a87edd6c0da44e66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeTestJSON-1109590207 May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 2007395425194750a87edd6c0da44e66 May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: 9958aaa8690c468da2acec47b2bb5f23 May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:52:00.305525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '84b45620-7dd5-4bb5-9da2-e48381d78256'} May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:52:00.306290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:52:00.307615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:00.308743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Returning 404 to user: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:52:00.308743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b654c587-49e2-4ac0-aca7-11616a86fd58 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 404 len: 111 microversion: 2.1 time: 0.038837 May 26 13:52:00.308743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 441/866] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:00 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:52:00.314696 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-acce61bf-b183-4a78-859c-52faeec91dac tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '.version_select at 0x7f07e04a05e0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:00.335401 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-acce61bf-b183-4a78-859c-52faeec91dac tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-901620882" status: 202 len: 0 microversion: 2.1 time: 0.024408 May 26 13:52:00.336438 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 426/867] 10.222.0.16 () {58 vars in 1217 bytes} [Thu May 26 13:52:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-901620882 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:52:00.338258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-24a3453a-5622-444d-94af-a7bfc42072b7 req-64c51efe-5f4e-4d94-89f1-23079df67f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6527206-c7a2-4458-97ed-915ee9b16cfb", "name": "network-vif-deleted", "tag": "cbc63303-0423-4bdd-8895-788f378a4ced"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:52:00.347573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-24a3453a-5622-444d-94af-a7bfc42072b7 req-64c51efe-5f4e-4d94-89f1-23079df67f74 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:00.348277 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-24a3453a-5622-444d-94af-a7bfc42072b7 req-64c51efe-5f4e-4d94-89f1-23079df67f74 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:00.360532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-24a3453a-5622-444d-94af-a7bfc42072b7 req-64c51efe-5f4e-4d94-89f1-23079df67f74 service nova] Creating event network-vif-deleted:cbc63303-0423-4bdd-8895-788f378a4ced for instance c6527206-c7a2-4458-97ed-915ee9b16cfb on hv-cinder-81966 May 26 13:52:00.366575 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-24a3453a-5622-444d-94af-a7bfc42072b7 req-64c51efe-5f4e-4d94-89f1-23079df67f74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032699 May 26 13:52:00.367227 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 442/868] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:52:01.013320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-21565259-529e-41a1-adec-bc8ef30ee079 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'create', calling method: .version_select at 0x7f07e02acb80>, body: {"keypair": {"name": "tempest-keypair-2132495400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEHegqlMiMw/rTMbsDRi0cr5oTIjFujtoNxnlkFHQuZJsAs7sGuRR01EaqGgWX6/0bElMGNDPv9nwJwqkDDVIigi9V+jcNn/5cmBzVzHWnMKCVs7dSF1W4jILZWOCn9/g=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:52:01.028652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-21565259-529e-41a1-adec-bc8ef30ee079 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Getting quotas for project 2007395425194750a87edd6c0da44e66. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:52:01.032442 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-21565259-529e-41a1-adec-bc8ef30ee079 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Getting quotas for user 9958aaa8690c468da2acec47b2bb5f23 and project 2007395425194750a87edd6c0da44e66. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:52:01.056031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-21565259-529e-41a1-adec-bc8ef30ee079 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047276 May 26 13:52:01.056646 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 427/869] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:52:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:52:01.139632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:01.140629 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] [instance: c6527206-c7a2-4458-97ed-915ee9b16cfb] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:01.157368 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:01.157789 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:01.158574 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:01.159009 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:01.174370 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] HTTP exception thrown: Instance c6527206-c7a2-4458-97ed-915ee9b16cfb could not be found. May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Request method failure captured: May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb HTTP/1.1 May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RbRUWuARFGkE_5vp-aUVCmAd1sOs3n7Bajq1lOXpZEUZd0FBaykhrcUrub2qPRQYXLnHjACEWP4w_Z4B9q9yTmJ2gk5KWB4cACUVTYnFQTvxh3ybkOd-tbUcxA__Sdrz4Pf61dXEV6D8lKHhkmLUd_V7SNHeFyJJ5tDhiruopzKPU May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:52:01.176994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_667a2ccd9c9045879b4b87e156997161", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/667a2ccd9c9045879b4b87e156997161"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 667a2ccd9c9045879b4b87e156997161 May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1176251209 May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: dd8055e46e6149d3897fb88af0b19d39 May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1176251209-project May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance c6527206-c7a2-4458-97ed-915ee9b16cfb could not be found. May 26 13:52:01.180213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'c6527206-c7a2-4458-97ed-915ee9b16cfb'} May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6527206-c7a2-4458-97ed-915ee9b16cfb could not be found. May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:52:01.181826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6527206-c7a2-4458-97ed-915ee9b16cfb could not be found. May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6527206-c7a2-4458-97ed-915ee9b16cfb could not be found. May 26 13:52:01.184120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:52:01.187690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] Returning 404 to user: Instance c6527206-c7a2-4458-97ed-915ee9b16cfb could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:52:01.187690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-86de09ff-afa9-4424-9632-ad71d15e340c tempest-ServerRescueNegativeTestJSON-1176251209 tempest-ServerRescueNegativeTestJSON-1176251209-project] 10.222.0.16 "GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb" status: 404 len: 111 microversion: 2.1 time: 0.043100 May 26 13:52:01.187690 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 443/870] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:01 2022] GET /compute/v2.1/servers/c6527206-c7a2-4458-97ed-915ee9b16cfb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:52:02.616124 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1266381770", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96b4b46b-ed06-4350-9763-5db4d4c655a1"}], "security_groups": [{"name": "tempest-securitygroup--1576421516"}], "key_name": "tempest-keypair-2132495400", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:52:02.728693 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] validate_networks() for [('96b4b46b-ed06-4350-9763-5db4d4c655a1', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:52:03.136172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:52:03.136703 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:52:03.137243 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:52:03.137653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:52:03.138060 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:52:03.147206 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:03.147651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:03.148496 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:03.148937 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:03.169380 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Getting quotas for project 2007395425194750a87edd6c0da44e66. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:52:03.178087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Getting quotas for user 9958aaa8690c468da2acec47b2bb5f23 and project 2007395425194750a87edd6c0da44e66. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:52:03.198693 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:52:03.203450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:52:03.282882 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-848d67df-7616-4d55-99be-f5540efd1bce tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671816 May 26 13:52:03.288367 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 428/871] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:52:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:52:03.307229 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-259f8686-51ad-4ecb-83f1-c46dd714bfbb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:03.307906 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-259f8686-51ad-4ecb-83f1-c46dd714bfbb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:03.414891 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-259f8686-51ad-4ecb-83f1-c46dd714bfbb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:03.421691 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-259f8686-51ad-4ecb-83f1-c46dd714bfbb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1238 microversion: 2.1 time: 0.122286 May 26 13:52:03.422638 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 444/872] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:03 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1238 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:52:04.439835 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-faeab77b-f1e5-4818-b4a3-3f851c8189bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:04.440485 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-faeab77b-f1e5-4818-b4a3-3f851c8189bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:04.448913 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-faeab77b-f1e5-4818-b4a3-3f851c8189bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:04.449518 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-faeab77b-f1e5-4818-b4a3-3f851c8189bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:04.450301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-faeab77b-f1e5-4818-b4a3-3f851c8189bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:04.450922 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-faeab77b-f1e5-4818-b4a3-3f851c8189bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:04.533036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-faeab77b-f1e5-4818-b4a3-3f851c8189bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:04.542814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-faeab77b-f1e5-4818-b4a3-3f851c8189bb tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1296 microversion: 2.1 time: 0.107614 May 26 13:52:04.543668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 429/873] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:04 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1296 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:05.561749 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-547f0559-8161-43f6-b039-58c8ef22b6b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:05.563061 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-547f0559-8161-43f6-b039-58c8ef22b6b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:05.571480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-547f0559-8161-43f6-b039-58c8ef22b6b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:05.572183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-547f0559-8161-43f6-b039-58c8ef22b6b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:05.573289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-547f0559-8161-43f6-b039-58c8ef22b6b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:05.573877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-547f0559-8161-43f6-b039-58c8ef22b6b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:05.721100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-547f0559-8161-43f6-b039-58c8ef22b6b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:05.725306 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:05.730648 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-547f0559-8161-43f6-b039-58c8ef22b6b6 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1364 microversion: 2.1 time: 0.172999 May 26 13:52:05.731223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 445/874] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:05 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:06.313978 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-f044d694-8a7a-49d8-aec6-45067a89cb0a req-50fb132c-41fe-4525-88b0-7a8d2bba1386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ff322d-f620-4f65-9264-a8ec49efb2b8", "tag": "896bf7dd-6b9f-467e-9c56-aa0be50361dc"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:52:06.338353 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f044d694-8a7a-49d8-aec6-45067a89cb0a req-50fb132c-41fe-4525-88b0-7a8d2bba1386 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:06.338798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-f044d694-8a7a-49d8-aec6-45067a89cb0a req-50fb132c-41fe-4525-88b0-7a8d2bba1386 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:06.351621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-f044d694-8a7a-49d8-aec6-45067a89cb0a req-50fb132c-41fe-4525-88b0-7a8d2bba1386 service nova] Creating event network-changed:896bf7dd-6b9f-467e-9c56-aa0be50361dc for instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 on hv-cinder-81966 May 26 13:52:06.363954 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-f044d694-8a7a-49d8-aec6-45067a89cb0a req-50fb132c-41fe-4525-88b0-7a8d2bba1386 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053405 May 26 13:52:06.364761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 430/875] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:52:06.748888 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-71217e9e-dc40-4899-8eb1-3f8f816c1202 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:06.749583 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-71217e9e-dc40-4899-8eb1-3f8f816c1202 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:06.760408 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-71217e9e-dc40-4899-8eb1-3f8f816c1202 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:06.760408 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-71217e9e-dc40-4899-8eb1-3f8f816c1202 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:06.762785 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-71217e9e-dc40-4899-8eb1-3f8f816c1202 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:06.763223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-71217e9e-dc40-4899-8eb1-3f8f816c1202 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:06.942805 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-71217e9e-dc40-4899-8eb1-3f8f816c1202 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:06.951078 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-71217e9e-dc40-4899-8eb1-3f8f816c1202 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1364 microversion: 2.1 time: 0.207474 May 26 13:52:06.957538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 446/876] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:06 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:07.969716 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d9649576-bf38-4189-bace-6cc90473fb7e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:07.970412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d9649576-bf38-4189-bace-6cc90473fb7e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:07.977927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d9649576-bf38-4189-bace-6cc90473fb7e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:07.978308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d9649576-bf38-4189-bace-6cc90473fb7e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:07.979076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d9649576-bf38-4189-bace-6cc90473fb7e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:07.979511 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d9649576-bf38-4189-bace-6cc90473fb7e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:08.120851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d9649576-bf38-4189-bace-6cc90473fb7e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:08.129260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d9649576-bf38-4189-bace-6cc90473fb7e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1364 microversion: 2.1 time: 0.163304 May 26 13:52:08.130218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 431/877] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:07 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:09.146983 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-193b996c-88e9-493b-bb96-117d054adadc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:09.147684 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-193b996c-88e9-493b-bb96-117d054adadc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:09.154444 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-193b996c-88e9-493b-bb96-117d054adadc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:09.155030 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-193b996c-88e9-493b-bb96-117d054adadc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:09.155809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-193b996c-88e9-493b-bb96-117d054adadc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:09.156239 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-193b996c-88e9-493b-bb96-117d054adadc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:09.348759 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-193b996c-88e9-493b-bb96-117d054adadc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:09.359953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-193b996c-88e9-493b-bb96-117d054adadc tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1364 microversion: 2.1 time: 0.217404 May 26 13:52:09.360848 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 447/878] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:09 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:10.380655 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bce00a3a-d51d-445f-b7ff-2a2992379996 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:10.381670 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bce00a3a-d51d-445f-b7ff-2a2992379996 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:10.387797 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bce00a3a-d51d-445f-b7ff-2a2992379996 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:10.388243 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bce00a3a-d51d-445f-b7ff-2a2992379996 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:10.389043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bce00a3a-d51d-445f-b7ff-2a2992379996 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:10.389475 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bce00a3a-d51d-445f-b7ff-2a2992379996 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:10.534753 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bce00a3a-d51d-445f-b7ff-2a2992379996 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:10.542457 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bce00a3a-d51d-445f-b7ff-2a2992379996 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1364 microversion: 2.1 time: 0.166546 May 26 13:52:10.551997 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 432/879] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:10 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:11.559284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-67267a69-69ce-4d57-9773-40c38c3ab69c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:11.559973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-67267a69-69ce-4d57-9773-40c38c3ab69c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:11.567873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-67267a69-69ce-4d57-9773-40c38c3ab69c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:11.568629 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-67267a69-69ce-4d57-9773-40c38c3ab69c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:11.569420 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-67267a69-69ce-4d57-9773-40c38c3ab69c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:11.569860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-67267a69-69ce-4d57-9773-40c38c3ab69c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:11.717999 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-67267a69-69ce-4d57-9773-40c38c3ab69c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:11.728355 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-67267a69-69ce-4d57-9773-40c38c3ab69c tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1364 microversion: 2.1 time: 0.173110 May 26 13:52:11.728915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 448/880] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:11 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:11.810089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-7cd93363-42a2-428a-8b1e-664e4bf214a9 req-8bad707f-ae4b-432e-9092-0bb4946ae398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ff322d-f620-4f65-9264-a8ec49efb2b8", "name": "network-vif-plugged", "status": "completed", "tag": "896bf7dd-6b9f-467e-9c56-aa0be50361dc"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:52:11.822240 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-7cd93363-42a2-428a-8b1e-664e4bf214a9 req-8bad707f-ae4b-432e-9092-0bb4946ae398 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:11.822932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-7cd93363-42a2-428a-8b1e-664e4bf214a9 req-8bad707f-ae4b-432e-9092-0bb4946ae398 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:11.837063 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-7cd93363-42a2-428a-8b1e-664e4bf214a9 req-8bad707f-ae4b-432e-9092-0bb4946ae398 service nova] Creating event network-vif-plugged:896bf7dd-6b9f-467e-9c56-aa0be50361dc for instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 on hv-cinder-81966 May 26 13:52:11.842932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-7cd93363-42a2-428a-8b1e-664e4bf214a9 req-8bad707f-ae4b-432e-9092-0bb4946ae398 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036590 May 26 13:52:11.843675 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 433/881] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:52:12.745849 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0fbe655c-344c-4c40-961d-da0c1df3f101 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:12.746470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0fbe655c-344c-4c40-961d-da0c1df3f101 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:12.753137 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0fbe655c-344c-4c40-961d-da0c1df3f101 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:12.753549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0fbe655c-344c-4c40-961d-da0c1df3f101 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:12.754319 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0fbe655c-344c-4c40-961d-da0c1df3f101 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:12.754872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0fbe655c-344c-4c40-961d-da0c1df3f101 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:12.887681 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0fbe655c-344c-4c40-961d-da0c1df3f101 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:12.895502 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0fbe655c-344c-4c40-961d-da0c1df3f101 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1364 microversion: 2.1 time: 0.153557 May 26 13:52:12.896068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 449/882] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:12 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:13.910883 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:13.911648 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=10 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:13.916424 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5b82aa92-380f-461a-816a-4b440fcc367f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:13.917143 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5b82aa92-380f-461a-816a-4b440fcc367f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:13.918994 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:13.926471 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b82aa92-380f-461a-816a-4b440fcc367f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:13.926926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b82aa92-380f-461a-816a-4b440fcc367f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:13.927704 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b82aa92-380f-461a-816a-4b440fcc367f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:13.928139 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5b82aa92-380f-461a-816a-4b440fcc367f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:14.061547 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5b82aa92-380f-461a-816a-4b440fcc367f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:14.069458 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5b82aa92-380f-461a-816a-4b440fcc367f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1550 microversion: 2.1 time: 0.161033 May 26 13:52:14.070039 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 434/883] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:52:13 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:52:14.086476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-042aea80-d07f-4e25-b9d0-366af8437a19 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:14.087102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-042aea80-d07f-4e25-b9d0-366af8437a19 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:14.091167 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:14.092378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:14.097481 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-042aea80-d07f-4e25-b9d0-366af8437a19 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:14.098112 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-042aea80-d07f-4e25-b9d0-366af8437a19 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:14.098884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-042aea80-d07f-4e25-b9d0-366af8437a19 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:14.099316 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-042aea80-d07f-4e25-b9d0-366af8437a19 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:14.179513 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-042aea80-d07f-4e25-b9d0-366af8437a19 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097223 May 26 13:52:14.180100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 450/884] 10.222.0.16 () {58 vars in 1274 bytes} [Thu May 26 13:52:14 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:52:15.479735 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-9e747407-295f-4441-bdc1-952b166391da req-206baa83-a555-419b-94de-5ff2243fc2cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ff322d-f620-4f65-9264-a8ec49efb2b8", "tag": "896bf7dd-6b9f-467e-9c56-aa0be50361dc"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:52:15.489994 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-9e747407-295f-4441-bdc1-952b166391da req-206baa83-a555-419b-94de-5ff2243fc2cb service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:15.491010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-9e747407-295f-4441-bdc1-952b166391da req-206baa83-a555-419b-94de-5ff2243fc2cb service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:15.505132 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-9e747407-295f-4441-bdc1-952b166391da req-206baa83-a555-419b-94de-5ff2243fc2cb service nova] Creating event network-changed:896bf7dd-6b9f-467e-9c56-aa0be50361dc for instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 on hv-cinder-81966 May 26 13:52:15.510540 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-9e747407-295f-4441-bdc1-952b166391da req-206baa83-a555-419b-94de-5ff2243fc2cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289095 May 26 13:52:15.511704 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 435/885] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:52:45.494835 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:45.495557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=28 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:45.499980 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9a824825-06ba-4efb-9013-0abd2d25479a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:45.500493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9a824825-06ba-4efb-9013-0abd2d25479a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:45.508048 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a824825-06ba-4efb-9013-0abd2d25479a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:45.508531 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a824825-06ba-4efb-9013-0abd2d25479a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:45.509284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a824825-06ba-4efb-9013-0abd2d25479a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:45.509710 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-9a824825-06ba-4efb-9013-0abd2d25479a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:45.532499 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9a824825-06ba-4efb-9013-0abd2d25479a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/ips" status: 200 len: 152 microversion: 2.20 time: 0.039057 May 26 13:52:45.533084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 451/886] 10.222.0.16 () {60 vars in 1288 bytes} [Thu May 26 13:52:45 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 13:52:48.519209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:48.519938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=36 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:52:48.524272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d9ca36e1-e0b6-4258-a88b-5adfd9679009 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:52:48.524908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d9ca36e1-e0b6-4258-a88b-5adfd9679009 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:48.531800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d9ca36e1-e0b6-4258-a88b-5adfd9679009 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:48.532241 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d9ca36e1-e0b6-4258-a88b-5adfd9679009 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:48.533028 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d9ca36e1-e0b6-4258-a88b-5adfd9679009 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:48.534064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d9ca36e1-e0b6-4258-a88b-5adfd9679009 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:48.556445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-d9ca36e1-e0b6-4258-a88b-5adfd9679009 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lazy-loading 'flavor' on Instance uuid aeccb394-4413-411c-a93c-9fbec3f06537 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:52:48.811742 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d9ca36e1-e0b6-4258-a88b-5adfd9679009 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/action" status: 202 len: 0 microversion: 2.20 time: 0.294605 May 26 13:52:48.812406 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 436/887] 10.222.0.16 () {62 vars in 1318 bytes} [Thu May 26 13:52:48 2022] POST /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 13:52:48.820819 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:48.821581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:48.827699 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:48.828231 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:48.828968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:48.829373 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:48.963067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:48.971482 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:48.973144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:48.974308 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bbb469a9-f4cb-47a9-bfca-16e3f4d32229 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.157659 May 26 13:52:48.974869 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 452/888] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:48 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:52:49.995072 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:49.995769 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:50.002829 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:50.003284 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:50.004055 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:50.004529 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:50.132731 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:50.140814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:50.142316 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:50.143557 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e25b684b-5e77-4f2c-924d-e0020d1fe4d9 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.153375 May 26 13:52:50.144117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 437/889] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:49 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:52:51.163387 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:51.163937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:51.171750 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:51.172195 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:51.173507 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:51.174289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:51.306141 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:51.314066 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:51.316316 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:51.317472 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-32cb3138-feec-4ba1-94b2-3dc3d817b3cd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.158286 May 26 13:52:51.318055 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 453/890] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:51 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:52:52.337215 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:52.337807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:52.343960 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:52.344436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:52.345194 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:52.345623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:52.479134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:52.487305 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:52.488851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:52.490016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1fb7c290-1184-466a-89b8-5a61ec1a4e20 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.157089 May 26 13:52:52.490578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 438/891] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:52 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:52:53.509221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:53.510135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:53.520034 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:53.520528 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:53.521315 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:53.522008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:53.651687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:53.659552 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:53.661075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:53.662246 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-326fb7f5-91de-433d-b92e-62a09575f51a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.156995 May 26 13:52:53.664532 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 454/892] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:53 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:52:54.681465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:54.682018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:54.688570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:54.689021 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:54.689883 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:54.690387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:54.818092 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:54.829583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:54.831480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:54.832719 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-629f4200-a2c4-41b4-87b6-1931801c2a0d tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.155530 May 26 13:52:54.833306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 439/893] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:54 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:52:55.851698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:55.852270 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:55.859271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:55.859719 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:55.860518 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:55.860953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:55.992550 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:56.000443 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:56.001961 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:56.003808 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-17fc1da2-900d-40f2-b7af-9793663a9248 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.156182 May 26 13:52:56.004397 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 455/894] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:55 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:52:57.022786 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:57.023398 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:57.029961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:57.030412 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:57.031179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:57.032106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:57.163100 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:57.171185 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:57.172998 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:57.174183 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0bcee18c-9f6b-4460-8ddd-d39125392628 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.155990 May 26 13:52:57.175017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 440/895] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:57 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:52:58.199296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:58.199905 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:58.206859 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:58.207296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:58.208047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:58.208507 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:58.334889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:58.342782 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:58.344292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:58.345475 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1147e114-f6a9-49ac-88cd-adf088440db5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.150070 May 26 13:52:58.346047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 456/896] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:58 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:52:59.368216 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:52:59.368860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:52:59.375787 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:59.376487 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:59.377655 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:52:59.378364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:52:59.507718 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:59.515652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:59.517179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:52:59.518969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3f06fc54-467d-43cf-9695-8c043cefabae tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.154563 May 26 13:52:59.519553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 441/897] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:52:59 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:00.537685 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:00.538285 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:00.544970 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:00.545415 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:00.546174 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:00.546608 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:00.681010 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:00.688973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:00.690489 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:00.691657 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b8b65961-16b7-4185-ad5b-7da6bd5e2813 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.158217 May 26 13:53:00.692223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 457/898] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:00 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:01.711374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:01.712013 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:01.719643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:01.720093 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:01.720916 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:01.721434 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:01.854126 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:01.863428 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:01.864978 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:01.866161 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8be8fac3-18c0-4268-a0b0-50a86279ec77 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.158745 May 26 13:53:01.866725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 442/899] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:01 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:02.885235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:02.885847 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:02.892358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:02.892815 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:02.894268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:02.894708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:03.023082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:03.030851 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:03.032357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:03.033512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e6039693-8d61-4f91-acd6-3a23aa69f28a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.152323 May 26 13:53:03.034195 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 458/900] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:02 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:04.051968 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:04.052659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:04.059184 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:04.059629 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:04.060424 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:04.060864 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:04.202406 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:04.210950 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:04.212473 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:04.213622 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f6e3fbef-3c6c-4a71-83ff-d3fbd53af5f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.165679 May 26 13:53:04.214179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 443/901] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:04 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:05.231952 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:05.232588 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:05.239503 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:05.239948 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:05.241134 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:05.241599 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:05.374509 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:05.385395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:05.387357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:05.388592 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-58547b30-7f53-4fa8-aa64-01eeaff22666 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1746 microversion: 2.20 time: 0.160481 May 26 13:53:05.389150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 459/902] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:05 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:06.417114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:06.417636 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:06.424260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:06.424928 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:06.426289 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:06.427042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:06.563205 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:06.571553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:06.573080 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:06.574254 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4dd067ce-ec36-4d19-9ea6-f98bbe2b7e42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1746 microversion: 2.20 time: 0.161408 May 26 13:53:06.574827 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 444/903] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:06 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:07.593565 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:07.594344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:07.601929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:07.602381 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:07.603152 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:07.603589 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:07.738712 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:07.746633 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:07.748121 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:07.749294 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b033c991-ff5f-4877-a7b1-12345ab8efa5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1746 microversion: 2.20 time: 0.159697 May 26 13:53:07.749854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 460/904] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:07 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:08.063516 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-c921fa70-5f1e-43d1-b24c-aac050a47006 req-cc6918b8-d827-4c58-aa95-7556558eed61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeccb394-4413-411c-a93c-9fbec3f06537", "name": "network-vif-plugged", "status": "completed", "tag": "7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:08.074097 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-c921fa70-5f1e-43d1-b24c-aac050a47006 req-cc6918b8-d827-4c58-aa95-7556558eed61 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:08.074572 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-c921fa70-5f1e-43d1-b24c-aac050a47006 req-cc6918b8-d827-4c58-aa95-7556558eed61 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:08.087116 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-c921fa70-5f1e-43d1-b24c-aac050a47006 req-cc6918b8-d827-4c58-aa95-7556558eed61 service nova] Creating event network-vif-plugged:7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa for instance aeccb394-4413-411c-a93c-9fbec3f06537 on hv-cinder-81966 May 26 13:53:08.092492 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-c921fa70-5f1e-43d1-b24c-aac050a47006 req-cc6918b8-d827-4c58-aa95-7556558eed61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032596 May 26 13:53:08.093112 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 445/905] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:53:08.767600 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:08.768253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:08.774996 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:08.775444 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:08.776209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:08.776671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:08.908025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:08.917456 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:08.918970 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:08.920176 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d7e4e515-8a79-4561-a583-b2e25d268fb4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1746 microversion: 2.20 time: 0.156452 May 26 13:53:08.920773 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 461/906] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:08 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:09.939653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:09.940917 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:09.948071 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:09.948554 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:09.949320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:09.949759 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:10.080055 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:10.088732 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:10.090221 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:10.091371 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06bf020b-ed5c-4905-b432-8fff30c61ef4 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1746 microversion: 2.20 time: 0.156330 May 26 13:53:10.091951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 446/907] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:09 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:11.110701 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:11.113092 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:11.126546 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:11.128862 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:11.130072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:11.130865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:11.538746 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:11.546894 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:11.553422 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:11.564650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-49386dc4-d550-4037-9d71-23b3774384c0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.448563 May 26 13:53:11.565831 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 462/908] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:11 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:12.241275 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-181004fa-ce2c-460c-b96c-22a867aa7ecb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:12.242521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-181004fa-ce2c-460c-b96c-22a867aa7ecb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:12.254944 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-181004fa-ce2c-460c-b96c-22a867aa7ecb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:12.255623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-181004fa-ce2c-460c-b96c-22a867aa7ecb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:12.256586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-181004fa-ce2c-460c-b96c-22a867aa7ecb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:12.258484 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-94ae8b4f-34ef-4d84-a031-a61b1e9387c7 req-d6bacc8c-ade3-4f9b-81fc-3d000511839c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb5af8d-022d-4708-aca9-49d3db482dcd", "tag": "04d681e3-ceab-4cf6-876e-aec8b3942d85"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:12.259784 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-181004fa-ce2c-460c-b96c-22a867aa7ecb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:12.280359 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-94ae8b4f-34ef-4d84-a031-a61b1e9387c7 req-d6bacc8c-ade3-4f9b-81fc-3d000511839c service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:12.280812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-94ae8b4f-34ef-4d84-a031-a61b1e9387c7 req-d6bacc8c-ade3-4f9b-81fc-3d000511839c service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:12.293980 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-94ae8b4f-34ef-4d84-a031-a61b1e9387c7 req-d6bacc8c-ade3-4f9b-81fc-3d000511839c service nova] Creating event network-changed:04d681e3-ceab-4cf6-876e-aec8b3942d85 for instance 2fb5af8d-022d-4708-aca9-49d3db482dcd on hv-cinder-81966 May 26 13:53:12.311455 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-181004fa-ce2c-460c-b96c-22a867aa7ecb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:53:12.324970 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-94ae8b4f-34ef-4d84-a031-a61b1e9387c7 req-d6bacc8c-ade3-4f9b-81fc-3d000511839c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048681 May 26 13:53:12.326705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 463/909] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:53:12.467518 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-181004fa-ce2c-460c-b96c-22a867aa7ecb tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 204 len: 0 microversion: 2.1 time: 0.229299 May 26 13:53:12.478327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 447/910] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:53:12 2022] DELETE /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:53:12.483885 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3596ed22-b444-4933-b0c2-53a935b8c59b tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:12.484833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3596ed22-b444-4933-b0c2-53a935b8c59b tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:12.505129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3596ed22-b444-4933-b0c2-53a935b8c59b tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:12.506196 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3596ed22-b444-4933-b0c2-53a935b8c59b tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:12.507581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3596ed22-b444-4933-b0c2-53a935b8c59b tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:12.508516 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3596ed22-b444-4933-b0c2-53a935b8c59b tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:12.591668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:12.592499 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:12.604356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:12.604910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:12.605754 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:12.606254 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:12.768478 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3596ed22-b444-4933-b0c2-53a935b8c59b tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:12.778067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3596ed22-b444-4933-b0c2-53a935b8c59b tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.298607 May 26 13:53:12.781519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 464/911] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:53:12 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:53:12.876326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:12.894225 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:12.895827 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:12.897083 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9c1e6d28-40ba-4b4e-bb20-13645bd31de0 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.314287 May 26 13:53:12.897876 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 448/912] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:12 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:13.798584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6baf01dd-8335-477e-b24f-6aca445811c2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:13.799196 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6baf01dd-8335-477e-b24f-6aca445811c2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:13.807815 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6baf01dd-8335-477e-b24f-6aca445811c2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:13.808565 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6baf01dd-8335-477e-b24f-6aca445811c2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:13.810184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6baf01dd-8335-477e-b24f-6aca445811c2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:13.810787 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6baf01dd-8335-477e-b24f-6aca445811c2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:13.918592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:13.920113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:13.935225 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:13.935674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:13.936728 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:13.936913 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:13.985341 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:14.048847 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6baf01dd-8335-477e-b24f-6aca445811c2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:14.061000 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6baf01dd-8335-477e-b24f-6aca445811c2 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1571 microversion: 2.1 time: 0.266341 May 26 13:53:14.062063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 465/913] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:53:13 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1571 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:53:14.131855 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:14.140888 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:14.142763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:14.144603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3c1cc6e0-f73f-4a5c-be58-1260b6c336e2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.229975 May 26 13:53:14.145891 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 449/914] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:13 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:15.049297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-db5b5a5d-0a88-4e30-a958-b6415126e2a6 req-ee6423f8-f430-41ff-a1b0-6ba9f6b81c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb5af8d-022d-4708-aca9-49d3db482dcd", "name": "network-vif-deleted", "tag": "04d681e3-ceab-4cf6-876e-aec8b3942d85"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:15.076681 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-db5b5a5d-0a88-4e30-a958-b6415126e2a6 req-ee6423f8-f430-41ff-a1b0-6ba9f6b81c34 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:15.077405 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-db5b5a5d-0a88-4e30-a958-b6415126e2a6 req-ee6423f8-f430-41ff-a1b0-6ba9f6b81c34 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:15.080783 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4a89c172-4664-4fad-aaaf-95fd45ffc6e9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:15.082464 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4a89c172-4664-4fad-aaaf-95fd45ffc6e9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:15.090273 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4a89c172-4664-4fad-aaaf-95fd45ffc6e9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:15.091013 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4a89c172-4664-4fad-aaaf-95fd45ffc6e9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:15.092168 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4a89c172-4664-4fad-aaaf-95fd45ffc6e9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:15.092802 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4a89c172-4664-4fad-aaaf-95fd45ffc6e9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:15.108949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-db5b5a5d-0a88-4e30-a958-b6415126e2a6 req-ee6423f8-f430-41ff-a1b0-6ba9f6b81c34 service nova] Creating event network-vif-deleted:04d681e3-ceab-4cf6-876e-aec8b3942d85 for instance 2fb5af8d-022d-4708-aca9-49d3db482dcd on hv-cinder-81966 May 26 13:53:15.117736 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-db5b5a5d-0a88-4e30-a958-b6415126e2a6 req-ee6423f8-f430-41ff-a1b0-6ba9f6b81c34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072323 May 26 13:53:15.118676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 466/915] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:53:15.165037 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:15.165730 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:15.173325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:15.174078 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:15.176156 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:15.177442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:15.201438 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4a89c172-4664-4fad-aaaf-95fd45ffc6e9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb847efec494be8a5a89da456f54d3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c85800d659ab43ff9b16266f9f037fc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:15.213972 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4a89c172-4664-4fad-aaaf-95fd45ffc6e9 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 200 len: 1384 microversion: 2.1 time: 0.136157 May 26 13:53:15.234002 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 450/916] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:53:15 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 1384 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:53:15.375494 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:15.389519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:15.392172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:15.395908 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-949ba46e-7676-4492-9059-6434c23387aa tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.234737 May 26 13:53:15.396957 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 467/917] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:15 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:16.236027 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:16.236650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] [instance: 2fb5af8d-022d-4708-aca9-49d3db482dcd] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:16.244262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:16.245095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:16.245879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:16.246478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:16.263399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] HTTP exception thrown: Instance 2fb5af8d-022d-4708-aca9-49d3db482dcd could not be found. May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Request method failure captured: May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd HTTP/1.1 May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4SuI5qHkvsQy8mAi-gGVnd1VzoFicU0UJ_gTqNx3937v2_Tw7K-Fr8aQdFWt15vg2QexGKplwSxl83FN0V1hgqZAVP99NLXKYFKgNPdnqDvuNtreM3v3fpqoVPamspTKgchT5gVlGVvOAa9uGlIs_KZn8HQeuxR8V4VxkhejA9sng4 May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: c85800d659ab43ff9b16266f9f037fc2 May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-TestShelveInstance-15139681 May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:53:16.266294 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c85800d659ab43ff9b16266f9f037fc2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c85800d659ab43ff9b16266f9f037fc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c85800d659ab43ff9b16266f9f037fc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c85800d659ab43ff9b16266f9f037fc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-TestShelveInstance-15139681 May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: c85800d659ab43ff9b16266f9f037fc2 May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-TestShelveInstance-15139681 May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-TestShelveInstance-15139681-project May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: bdb847efec494be8a5a89da456f54d3d May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-TestShelveInstance-15139681-project May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 2fb5af8d-022d-4708-aca9-49d3db482dcd could not be found. May 26 13:53:16.267930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '2fb5af8d-022d-4708-aca9-49d3db482dcd'} May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb5af8d-022d-4708-aca9-49d3db482dcd could not be found. May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:53:16.269142 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb5af8d-022d-4708-aca9-49d3db482dcd could not be found. May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb5af8d-022d-4708-aca9-49d3db482dcd could not be found. May 26 13:53:16.271681 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:53:16.274077 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Returning 404 to user: Instance 2fb5af8d-022d-4708-aca9-49d3db482dcd could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:53:16.274077 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c1acb70b-48da-475e-818b-e215eff85346 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd" status: 404 len: 111 microversion: 2.1 time: 0.037249 May 26 13:53:16.274906 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 451/918] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:53:16 2022] GET /compute/v2.1/servers/2fb5af8d-022d-4708-aca9-49d3db482dcd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:53:16.419625 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:16.420283 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:16.431922 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=35 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:16.448778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:16.450057 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:16.451945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:16.452569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:16.458206 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=93 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:16.497347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-44d760ee-db47-43b4-8694-dfd893bdb552 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] Calling method '.version_select at 0x7f07e03d30d0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:16.524234 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-44d760ee-db47-43b4-8694-dfd893bdb552 tempest-TestShelveInstance-15139681 tempest-TestShelveInstance-15139681-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2123729586" status: 202 len: 0 microversion: 2.1 time: 0.030522 May 26 13:53:16.526090 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 452/919] 10.222.0.16 () {58 vars in 1253 bytes} [Thu May 26 13:53:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2123729586 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:53:16.700608 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:16.710127 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:16.712017 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:16.713659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-410b0634-0adb-44c7-ac91-c7f33a810819 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.300724 May 26 13:53:16.714684 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 468/920] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:16 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:17.746846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:17.750482 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:17.767335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:17.768105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:17.770092 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:17.770745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:18.100079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:18.113333 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:18.126190 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:18.127441 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-455de4c6-9bb2-4e76-841e-68b9ed4fd84a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.393903 May 26 13:53:18.128392 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 453/921] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:17 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:19.147876 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:19.149198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:19.161190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:19.163157 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:19.168526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:19.169217 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:19.427251 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:19.437708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:19.439948 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:19.441896 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-14fa4953-3974-411e-8e48-946a2726277a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.298585 May 26 13:53:19.442955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 469/922] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:19 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:20.464568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:20.465194 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:20.476673 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:20.482707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:20.484758 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:20.485764 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:20.488388 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:20.834184 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:20.860404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:20.865248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:20.867314 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-36f633af-9f9c-47be-bd75-8a1d14c83491 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.409917 May 26 13:53:20.870136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 454/923] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:20 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:21.889507 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:21.890731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:21.900552 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:21.901290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:21.902997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:21.903605 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:22.170613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:22.181896 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:22.187129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:22.190221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7d8ac04c-e87a-428e-ad29-f8c88ab4d8c2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.304938 May 26 13:53:22.203135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 470/924] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:21 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:23.210921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:23.211513 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:23.232047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:23.232526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:23.236031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:23.242596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:23.790324 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:23.810836 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:23.819524 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:23.824179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-035d10a1-5e3b-43d6-9119-333da17e4108 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.614810 May 26 13:53:23.837408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 455/925] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:23 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:24.848340 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:24.850366 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:24.859043 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:24.870025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:24.873678 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:24.878722 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:25.432973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:25.460932 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:25.463769 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:25.466089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b17ad5cc-b8ab-44b5-8214-357100088bad tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1741 microversion: 2.20 time: 0.622856 May 26 13:53:25.467419 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 471/926] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:24 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1741 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:26.490352 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:26.491045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:26.525887 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:26.527279 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:26.529640 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:26.530402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:26.995757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:27.006480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:27.011090 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:27.016860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9845716a-0a00-4fa5-9061-502fdae19f10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1723 microversion: 2.20 time: 0.533522 May 26 13:53:27.032565 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 456/927] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:26 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1723 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:28.041909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:28.044909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:28.058128 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:28.059830 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:28.061848 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:28.068915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:28.306143 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:28.314557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:28.316441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:28.317947 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e13be6d0-1757-4f2e-8be9-37462ebd6a8c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1723 microversion: 2.20 time: 0.284656 May 26 13:53:28.318509 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 472/928] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:28 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:29.340511 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:29.341363 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:29.353228 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:29.355851 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:29.357909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:29.359176 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:29.524756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:29.536683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:29.539617 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:29.539772 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d667a067-e211-4b1b-8249-26b297ba65db tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1726 microversion: 2.20 time: 0.207150 May 26 13:53:29.540683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 457/929] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:29 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1726 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:29.558623 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2a632795-9eaa-4092-8612-9c108641807e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "278bf128-a0b9-42ae-89a7-f7651707896c"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:29.560743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2a632795-9eaa-4092-8612-9c108641807e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:29.568704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2a632795-9eaa-4092-8612-9c108641807e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:29.569256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2a632795-9eaa-4092-8612-9c108641807e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:29.570132 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2a632795-9eaa-4092-8612-9c108641807e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:29.570662 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2a632795-9eaa-4092-8612-9c108641807e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:29.965326 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2a632795-9eaa-4092-8612-9c108641807e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.410598 May 26 13:53:29.966979 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 473/930] 10.222.0.16 () {62 vars in 1363 bytes} [Thu May 26 13:53:29 2022] POST /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/os-volume_attachments => generated 188 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 13:53:30.150237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1724e673-e35c-4011-986a-825bdd9c9408 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:30.150735 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1724e673-e35c-4011-986a-825bdd9c9408 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:30.165956 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1724e673-e35c-4011-986a-825bdd9c9408 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:30.166568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1724e673-e35c-4011-986a-825bdd9c9408 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:30.167562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1724e673-e35c-4011-986a-825bdd9c9408 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:30.168014 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1724e673-e35c-4011-986a-825bdd9c9408 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:30.471444 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-ee7ab3f6-b280-4fb2-94fd-81df4e051f04 req-ec73e67e-9248-45ea-8d1d-62e21904d07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeccb394-4413-411c-a93c-9fbec3f06537", "name": "network-vif-unplugged", "status": "completed", "tag": "7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:30.490597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-ee7ab3f6-b280-4fb2-94fd-81df4e051f04 req-ec73e67e-9248-45ea-8d1d-62e21904d07e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:30.491106 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-ee7ab3f6-b280-4fb2-94fd-81df4e051f04 req-ec73e67e-9248-45ea-8d1d-62e21904d07e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:30.512725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.compute.server_external_events [req-ee7ab3f6-b280-4fb2-94fd-81df4e051f04 req-ec73e67e-9248-45ea-8d1d-62e21904d07e service nova] Unable to find a host for instance aeccb394-4413-411c-a93c-9fbec3f06537. Dropping event network-vif-unplugged {{(pid=124240) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 13:53:30.513767 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-ee7ab3f6-b280-4fb2-94fd-81df4e051f04 req-ec73e67e-9248-45ea-8d1d-62e21904d07e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047065 May 26 13:53:30.514408 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 474/931] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 13:53:30.590447 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1724e673-e35c-4011-986a-825bdd9c9408 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/os-volume_attachments/278bf128-a0b9-42ae-89a7-f7651707896c" status: 202 len: 0 microversion: 2.20 time: 0.444050 May 26 13:53:30.591305 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 458/932] 10.222.0.16 () {60 vars in 1456 bytes} [Thu May 26 13:53:30 2022] DELETE /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/os-volume_attachments/278bf128-a0b9-42ae-89a7-f7651707896c => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 13:53:30.659183 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4c1bc26d-f682-4dc2-bbdb-dd58145b7498 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:30.660420 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4c1bc26d-f682-4dc2-bbdb-dd58145b7498 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:30.684553 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4c1bc26d-f682-4dc2-bbdb-dd58145b7498 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:30.685817 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4c1bc26d-f682-4dc2-bbdb-dd58145b7498 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:30.687355 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4c1bc26d-f682-4dc2-bbdb-dd58145b7498 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:30.688483 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4c1bc26d-f682-4dc2-bbdb-dd58145b7498 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:30.859082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4c1bc26d-f682-4dc2-bbdb-dd58145b7498 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "POST /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/action" status: 202 len: 0 microversion: 2.20 time: 0.204031 May 26 13:53:30.859960 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 475/933] 10.222.0.16 () {62 vars in 1318 bytes} [Thu May 26 13:53:30 2022] POST /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 13:53:30.869418 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:30.870483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:30.878857 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:30.879846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:30.881925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:30.882879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:31.306069 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:31.331845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:31.334218 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:31.336225 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8ab9b7b4-c623-4109-97f7-2a8d63fc4c7a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1674 microversion: 2.20 time: 0.471643 May 26 13:53:31.337746 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 459/934] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:30 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1674 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:32.355398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:32.356715 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:32.365973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:32.367274 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:32.368361 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:32.369019 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:32.681955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:32.727932 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:32.731168 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:32.732427 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-73c75159-8f03-42ea-a750-9bab734f591c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.381248 May 26 13:53:32.735462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 476/935] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:32 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:33.751624 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:33.757266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:33.776940 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:33.778221 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:33.780263 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:33.781001 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:33.953247 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:33.962971 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:33.964539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:33.965719 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-20abd322-7bc4-48d8-9186-a19638a25dfe tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.217997 May 26 13:53:33.980480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 477/936] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:33 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:33.990357 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e7c7516c-ef28-4718-b928-f1e54722122e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Action: 'create', calling method: .version_select at 0x7f07e049bb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-18808065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx/KcFYmkWurUMHct57Y1js/VBsda8TsVFp/0f/weBNx9O2B2Ek14LaPbmNPqWFpng/hUFSdKkef+YwLGFY62wnxZ5LBm5NUT6Fo7C9PJwlwh2BY9QHYwNOSVktldpe4A=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:34.006256 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-e7c7516c-ef28-4718-b928-f1e54722122e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Getting quotas for project 189885bf9a5944bf8eaedd89bb5bec9f. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:53:34.010949 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-e7c7516c-ef28-4718-b928-f1e54722122e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Getting quotas for user f98684788906448bb3b35af5a2fc017f and project 189885bf9a5944bf8eaedd89bb5bec9f. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:53:34.037483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e7c7516c-ef28-4718-b928-f1e54722122e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.297805 May 26 13:53:34.038479 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 460/937] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:53:33 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:53:34.985778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:34.986402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:35.011103 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:35.011559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:35.013809 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:35.014458 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:35.279203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:35.294475 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:35.299077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:35.302949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-74c5fe26-012a-477a-8fd3-734016834780 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.320871 May 26 13:53:35.304523 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 478/938] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:34 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:36.325801 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:36.326419 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:36.334478 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:36.335202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:36.335999 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:36.336473 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:36.638927 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:36.647628 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:36.649307 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:36.650689 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-75883aaf-d0b8-44ec-b5cc-bd726e146c98 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.329467 May 26 13:53:36.667971 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 461/939] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:36 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:37.671895 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:37.673278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:37.689203 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:37.690071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:37.696143 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:37.697263 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:37.853038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:37.862686 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:37.864518 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:37.865908 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5e68b37f-92a0-4836-a0e3-eedf263b7620 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.198378 May 26 13:53:37.866616 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 479/940] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:37 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:38.886968 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:38.888280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:38.899398 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:38.899859 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:38.900696 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:38.901140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:39.455339 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:39.468016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:39.469563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:39.470973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c735ba09-2573-468a-8187-d3db35e57e22 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.587771 May 26 13:53:39.471625 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 462/941] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:38 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:40.493872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:40.494487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:40.502220 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:40.502675 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:40.504499 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:40.505067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:40.658510 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:40.668824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:40.670698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:40.672296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-86211cfe-b5eb-43ad-8ac5-bc62976454ee tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.182350 May 26 13:53:40.673063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 480/942] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:40 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:41.696988 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:41.698178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:41.709781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:41.710461 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:41.711359 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:41.711860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:41.914777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:41.922517 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:41.924487 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:41.925959 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8c76cc05-0d9c-4298-8a4f-da80b6998e97 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.234436 May 26 13:53:41.926768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 463/943] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:41 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:42.961448 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:42.962186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:42.970225 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:42.970678 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:42.971472 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:42.973046 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:43.143043 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:43.145702 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:43.155965 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:43.157624 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:43.158887 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5f5d6ce3-1109-4a7e-86e4-18991f252672 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.217157 May 26 13:53:43.160152 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 481/944] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:42 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:44.176045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:44.180465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:44.181074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:44.187327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:44.187766 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:44.188547 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:44.188975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:44.192111 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:44.339265 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:44.348962 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:44.350799 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:44.352396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cd71c80f-b4c2-47e4-a05c-362ba47cddb8 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.178037 May 26 13:53:44.353062 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 464/945] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:44 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:44.941175 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-25bd0617-62f8-46c4-9727-db8ee66718f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:44.941689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-25bd0617-62f8-46c4-9727-db8ee66718f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:44.949879 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-25bd0617-62f8-46c4-9727-db8ee66718f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:44.950327 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-25bd0617-62f8-46c4-9727-db8ee66718f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:44.951104 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-25bd0617-62f8-46c4-9727-db8ee66718f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:44.951537 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-25bd0617-62f8-46c4-9727-db8ee66718f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:44.977219 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-25bd0617-62f8-46c4-9727-db8ee66718f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/ips" status: 200 len: 146 microversion: 2.1 time: 0.040709 May 26 13:53:44.977807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 482/946] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:53:44 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:53:45.371283 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:45.371894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:45.379481 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:45.379481 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:45.380190 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:45.380668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:45.515798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:45.524415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:45.525940 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:45.527123 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-98338f26-3fda-4703-9772-4bd72f9c45bc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.159877 May 26 13:53:45.527707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 465/947] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:45 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:46.545902 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:46.546968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:46.551331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=32 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:46.559518 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:46.560051 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:46.561023 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:46.561526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:46.695271 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:46.703453 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:46.704978 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:46.706671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-77ea114e-c9e5-4af8-b078-71a512834c55 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.164236 May 26 13:53:46.707568 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 483/948] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:46 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:47.357770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-27a625c9-f2cb-4507-a4ed-a702d629039e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e08eb81-68a1-4b94-ac49-5aa93654c6cd"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:47.358826 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-27a625c9-f2cb-4507-a4ed-a702d629039e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:47.366327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27a625c9-f2cb-4507-a4ed-a702d629039e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:47.366782 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27a625c9-f2cb-4507-a4ed-a702d629039e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:47.367547 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27a625c9-f2cb-4507-a4ed-a702d629039e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:47.367986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27a625c9-f2cb-4507-a4ed-a702d629039e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:47.725456 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:47.726056 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:47.732597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:47.733045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:47.733806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:47.734240 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:47.884708 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:47.894008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:47.895637 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:47.897038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2237dd30-46c1-4a5f-b4a9-7c7adc291bed tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.176074 May 26 13:53:47.897635 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 484/949] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:47 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:48.915263 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:48.916931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:48.924125 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:48.924689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:48.926027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:48.926522 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:49.060090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:49.068195 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:49.069788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:49.070950 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7f4c4e6a-a20d-4b5e-8dc7-f4e651286e4e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.159596 May 26 13:53:49.071516 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 485/950] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:48 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:50.089205 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:50.089871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:50.096539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:50.097157 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:50.097942 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:50.098380 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:50.229253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:50.237163 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:50.239356 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:50.240559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dfaccb14-4591-40c9-9f0e-aa766ff03c30 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.155251 May 26 13:53:50.241129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 486/951] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:50 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:51.039656 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-27a625c9-f2cb-4507-a4ed-a702d629039e tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.685604 May 26 13:53:51.040480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 466/952] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:53:47 2022] POST /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments => generated 194 bytes in 3687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:53:51.259071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:51.259679 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:51.270660 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:51.271129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:51.271895 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:51.272350 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:51.405742 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:51.413644 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:51.415129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:51.416264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-036bd924-b3ca-41f6-8817-b8cadcad002e tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.161127 May 26 13:53:51.416841 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 487/953] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:51 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:52.434823 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:52.435518 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:52.439281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:53:52.445105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:52.445553 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:52.446327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:52.446763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:52.576238 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:52.584642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:52.586181 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:52.587488 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eb81361a-3ccc-4713-b03d-7b68cad56dcb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.156922 May 26 13:53:52.588065 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 467/954] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:52 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:53.606082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:53.606695 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:53.613338 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:53.613785 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:53.614544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:53.615053 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:53.749534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:53.758268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:53.759793 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:53.761067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-eae1f907-38d7-4451-9702-366868d80028 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.158866 May 26 13:53:53.761693 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 488/955] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:53 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 13:53:54.258014 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-358ed9b8-90db-4f13-b718-95ccbf105d17 req-ac220ffa-af18-49ad-b906-821a87ad18cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeccb394-4413-411c-a93c-9fbec3f06537", "name": "network-vif-plugged", "status": "completed", "tag": "7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:54.266856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-358ed9b8-90db-4f13-b718-95ccbf105d17 req-ac220ffa-af18-49ad-b906-821a87ad18cf service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:54.267465 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-358ed9b8-90db-4f13-b718-95ccbf105d17 req-ac220ffa-af18-49ad-b906-821a87ad18cf service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:54.279461 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-358ed9b8-90db-4f13-b718-95ccbf105d17 req-ac220ffa-af18-49ad-b906-821a87ad18cf service nova] Creating event network-vif-plugged:7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa for instance aeccb394-4413-411c-a93c-9fbec3f06537 on hv-cinder-81966 May 26 13:53:54.284781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-358ed9b8-90db-4f13-b718-95ccbf105d17 req-ac220ffa-af18-49ad-b906-821a87ad18cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030984 May 26 13:53:54.285409 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 468/956] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:53:54.781004 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:54.781556 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:54.788696 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:54.789139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:54.789889 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:54.790319 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:55.193673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:55.201865 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:55.203399 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:55.204585 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d63194c8-a1b0-440f-babb-5c5967071208 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.427617 May 26 13:53:55.205144 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 489/957] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:54 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:56.224089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:56.224856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:56.231410 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:56.231860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:56.232652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:56.233091 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:56.366777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:56.375881 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:56.377836 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:56.379899 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7d8749b8-b572-456d-a01d-976c6f24652c tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.160650 May 26 13:53:56.380512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 469/958] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:56 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:57.399692 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:57.400325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:57.407369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:57.407816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:57.408610 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:57.409042 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:57.547992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:57.556218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:57.557754 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:57.558917 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0f3f71ec-b917-49a6-bf68-6693262ce5c7 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1732 microversion: 2.20 time: 0.163377 May 26 13:53:57.559478 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 490/959] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:57 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:58.517211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1381135305", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-18808065", "security_groups": [{"name": "tempest-secgroup-smoke-1175980800"}], "block_device_mapping_v2": [{"uuid": "0b0e09b7-79f7-4a1a-8710-03604dc7e80c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f13feac7-9894-4fb0-8d65-5458a77bde4c"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:53:58.549565 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-cd94ec16-9cce-4bc6-a307-f2fcd0845e13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:58.551241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-cd94ec16-9cce-4bc6-a307-f2fcd0845e13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:58.557796 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cd94ec16-9cce-4bc6-a307-f2fcd0845e13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:58.558248 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cd94ec16-9cce-4bc6-a307-f2fcd0845e13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:58.559017 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cd94ec16-9cce-4bc6-a307-f2fcd0845e13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:58.559451 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cd94ec16-9cce-4bc6-a307-f2fcd0845e13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:58.592728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-cd94ec16-9cce-4bc6-a307-f2fcd0845e13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046950 May 26 13:53:58.593290 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 491/960] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:53:58 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:53:58.599645 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:58.600298 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:58.606246 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:58.606688 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:58.607458 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:58.607873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:58.640940 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] validate_networks() for [('f13feac7-9894-4fb0-8d65-5458a77bde4c', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:53:58.748232 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:58.757434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:58.758938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:58.760133 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dfa8b459-0159-4f23-a5b6-23e1df8f5cb5 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1719 microversion: 2.20 time: 0.164848 May 26 13:53:58.760714 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 492/961] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:53:58 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:53:58.765583 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0a22527a-78d8-4ddf-84c5-9d7441f5cf13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:58.766072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0a22527a-78d8-4ddf-84c5-9d7441f5cf13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:58.772672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0a22527a-78d8-4ddf-84c5-9d7441f5cf13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:58.773123 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0a22527a-78d8-4ddf-84c5-9d7441f5cf13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:58.773892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0a22527a-78d8-4ddf-84c5-9d7441f5cf13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:58.774319 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0a22527a-78d8-4ddf-84c5-9d7441f5cf13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:58.806080 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0a22527a-78d8-4ddf-84c5-9d7441f5cf13 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/5e08eb81-68a1-4b94-ac49-5aa93654c6cd" status: 200 len: 194 microversion: 2.1 time: 0.044122 May 26 13:53:58.807083 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 493/962] 10.222.0.16 () {58 vars in 1412 bytes} [Thu May 26 13:53:58 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/5e08eb81-68a1-4b94-ac49-5aa93654c6cd => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:53:59.061335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:53:59.062081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:53:59.062623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:53:59.063303 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:53:59.063926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:53:59.074487 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:59.074946 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:59.075754 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:53:59.076197 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:53:59.104530 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Getting quotas for project 189885bf9a5944bf8eaedd89bb5bec9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:53:59.109437 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Getting quotas for user f98684788906448bb3b35af5a2fc017f and project 189885bf9a5944bf8eaedd89bb5bec9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:53:59.175160 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:53:59.177413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b0e09b7-79f7-4a1a-8710-03604dc7e80c',volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:53:59.307611 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b8aa9912-24b7-4bbd-b250-f3ca36c58835 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.794195 May 26 13:53:59.308256 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 470/963] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:53:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:53:59.318257 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-9109250a-6ab1-4e86-893d-ac389080cd8f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:53:59.318871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-9109250a-6ab1-4e86-893d-ac389080cd8f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:53:59.371863 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-9109250a-6ab1-4e86-893d-ac389080cd8f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:53:59.378719 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-9109250a-6ab1-4e86-893d-ac389080cd8f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1093 microversion: 2.1 time: 0.064284 May 26 13:53:59.379244 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 494/964] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:53:59 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:00.139821 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c9a86dfd-a923-4f1b-a8ba-db91a3547c90 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9e50b98-4115-4e70-85bc-db55c73342b1"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:54:00.140973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c9a86dfd-a923-4f1b-a8ba-db91a3547c90 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:00.148347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c9a86dfd-a923-4f1b-a8ba-db91a3547c90 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:00.148798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c9a86dfd-a923-4f1b-a8ba-db91a3547c90 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:00.149573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c9a86dfd-a923-4f1b-a8ba-db91a3547c90 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:00.150003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c9a86dfd-a923-4f1b-a8ba-db91a3547c90 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:00.399757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-97f60935-d64c-47b8-8b6d-a3952c495a4a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:00.400573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-97f60935-d64c-47b8-8b6d-a3952c495a4a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:00.415875 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97f60935-d64c-47b8-8b6d-a3952c495a4a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:00.416467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97f60935-d64c-47b8-8b6d-a3952c495a4a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:00.417566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97f60935-d64c-47b8-8b6d-a3952c495a4a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:00.418111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97f60935-d64c-47b8-8b6d-a3952c495a4a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:00.433552 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c9a86dfd-a923-4f1b-a8ba-db91a3547c90 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "POST /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298045 May 26 13:54:00.434433 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 471/965] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:54:00 2022] POST /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:00.506826 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-97f60935-d64c-47b8-8b6d-a3952c495a4a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:00.514608 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-97f60935-d64c-47b8-8b6d-a3952c495a4a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1209 microversion: 2.1 time: 0.122246 May 26 13:54:00.515181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 495/966] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:00 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:54:01.538899 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a30ec201-3535-4846-ae81-e256eb72c56c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:01.539618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a30ec201-3535-4846-ae81-e256eb72c56c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:01.548487 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a30ec201-3535-4846-ae81-e256eb72c56c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:01.549081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a30ec201-3535-4846-ae81-e256eb72c56c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:01.550260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a30ec201-3535-4846-ae81-e256eb72c56c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:01.550937 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a30ec201-3535-4846-ae81-e256eb72c56c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:01.766186 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a30ec201-3535-4846-ae81-e256eb72c56c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:01.777371 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a30ec201-3535-4846-ae81-e256eb72c56c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.248390 May 26 13:54:01.778408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 472/967] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:01 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:01.793898 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-a82bd623-f35d-483d-9f92-68fb7eb7242f req-af825514-13d7-45cb-b850-6620701686cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2f0c112-3ce9-43ea-8c2b-421193107cd2", "tag": "cedaf787-c283-41ca-8699-4bca18f84374"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:54:01.810337 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-a82bd623-f35d-483d-9f92-68fb7eb7242f req-af825514-13d7-45cb-b850-6620701686cf service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:01.811260 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-a82bd623-f35d-483d-9f92-68fb7eb7242f req-af825514-13d7-45cb-b850-6620701686cf service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:01.828243 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-a82bd623-f35d-483d-9f92-68fb7eb7242f req-af825514-13d7-45cb-b850-6620701686cf service nova] Creating event network-changed:cedaf787-c283-41ca-8699-4bca18f84374 for instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 on hv-cinder-81966 May 26 13:54:01.834709 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-a82bd623-f35d-483d-9f92-68fb7eb7242f req-af825514-13d7-45cb-b850-6620701686cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044894 May 26 13:54:01.835479 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 496/968] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:02.794480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6db0629b-d7fe-4d71-8b97-97d9c240d1a3 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:02.795081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6db0629b-d7fe-4d71-8b97-97d9c240d1a3 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:02.801720 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6db0629b-d7fe-4d71-8b97-97d9c240d1a3 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:02.802162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6db0629b-d7fe-4d71-8b97-97d9c240d1a3 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:02.802920 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6db0629b-d7fe-4d71-8b97-97d9c240d1a3 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:02.803349 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6db0629b-d7fe-4d71-8b97-97d9c240d1a3 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:02.938017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-6db0629b-d7fe-4d71-8b97-97d9c240d1a3 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:02.946270 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6db0629b-d7fe-4d71-8b97-97d9c240d1a3 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.155619 May 26 13:54:02.946841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 473/969] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:02 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:03.964217 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-153410d9-1d3c-4402-bf9d-04c4695d4609 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:03.964955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-153410d9-1d3c-4402-bf9d-04c4695d4609 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:03.971772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-153410d9-1d3c-4402-bf9d-04c4695d4609 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:03.973068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-153410d9-1d3c-4402-bf9d-04c4695d4609 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:03.973843 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-153410d9-1d3c-4402-bf9d-04c4695d4609 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:03.974286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-153410d9-1d3c-4402-bf9d-04c4695d4609 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:04.107421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-153410d9-1d3c-4402-bf9d-04c4695d4609 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:04.115227 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-153410d9-1d3c-4402-bf9d-04c4695d4609 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.155235 May 26 13:54:04.115791 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 497/970] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:03 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:05.131737 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-653d811a-f068-4336-8125-816976145565 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:05.132413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-653d811a-f068-4336-8125-816976145565 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:05.138897 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-653d811a-f068-4336-8125-816976145565 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:05.139343 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-653d811a-f068-4336-8125-816976145565 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:05.140105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-653d811a-f068-4336-8125-816976145565 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:05.140568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-653d811a-f068-4336-8125-816976145565 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:05.274524 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-653d811a-f068-4336-8125-816976145565 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:05.281966 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-653d811a-f068-4336-8125-816976145565 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.154211 May 26 13:54:05.282528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 474/971] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:05 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:06.298650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-241fb486-fc37-4be7-abf7-202e9f14028a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:06.299256 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-241fb486-fc37-4be7-abf7-202e9f14028a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:06.305927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-241fb486-fc37-4be7-abf7-202e9f14028a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:06.306368 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-241fb486-fc37-4be7-abf7-202e9f14028a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:06.307123 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-241fb486-fc37-4be7-abf7-202e9f14028a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:06.307554 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-241fb486-fc37-4be7-abf7-202e9f14028a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:06.437800 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-241fb486-fc37-4be7-abf7-202e9f14028a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:06.445914 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-241fb486-fc37-4be7-abf7-202e9f14028a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.151084 May 26 13:54:06.446481 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 498/972] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:06 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:07.463932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ee699731-b9d6-4d30-95f5-bb38a2d05334 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:07.464580 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ee699731-b9d6-4d30-95f5-bb38a2d05334 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:07.472626 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee699731-b9d6-4d30-95f5-bb38a2d05334 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:07.473095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee699731-b9d6-4d30-95f5-bb38a2d05334 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:07.479628 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee699731-b9d6-4d30-95f5-bb38a2d05334 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:07.479628 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ee699731-b9d6-4d30-95f5-bb38a2d05334 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:07.620636 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ee699731-b9d6-4d30-95f5-bb38a2d05334 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:07.628568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ee699731-b9d6-4d30-95f5-bb38a2d05334 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.168442 May 26 13:54:07.629149 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 475/973] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:07 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:07.956399 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e1690e5a-f79c-43f3-b4f9-46b69f8d5eb3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:07.958171 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e1690e5a-f79c-43f3-b4f9-46b69f8d5eb3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:07.964788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e1690e5a-f79c-43f3-b4f9-46b69f8d5eb3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:07.965236 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e1690e5a-f79c-43f3-b4f9-46b69f8d5eb3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:07.966012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e1690e5a-f79c-43f3-b4f9-46b69f8d5eb3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:07.966443 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e1690e5a-f79c-43f3-b4f9-46b69f8d5eb3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:07.995253 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e1690e5a-f79c-43f3-b4f9-46b69f8d5eb3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042829 May 26 13:54:07.995811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 499/974] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:54:07 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:08.092634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a6c646ea-36bb-4149-8f08-417150110602 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:08.093131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a6c646ea-36bb-4149-8f08-417150110602 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:08.099462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6c646ea-36bb-4149-8f08-417150110602 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:08.099909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6c646ea-36bb-4149-8f08-417150110602 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:08.100706 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6c646ea-36bb-4149-8f08-417150110602 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:08.101146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a6c646ea-36bb-4149-8f08-417150110602 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:08.132162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a6c646ea-36bb-4149-8f08-417150110602 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/5e08eb81-68a1-4b94-ac49-5aa93654c6cd" status: 200 len: 194 microversion: 2.1 time: 0.043551 May 26 13:54:08.132723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 476/975] 10.222.0.16 () {58 vars in 1412 bytes} [Thu May 26 13:54:08 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/5e08eb81-68a1-4b94-ac49-5aa93654c6cd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:08.142833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b9606240-2291-4bdc-a503-7eac3546cf4f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:08.143331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b9606240-2291-4bdc-a503-7eac3546cf4f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:08.149955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b9606240-2291-4bdc-a503-7eac3546cf4f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:08.150407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b9606240-2291-4bdc-a503-7eac3546cf4f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:08.151171 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b9606240-2291-4bdc-a503-7eac3546cf4f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:08.151606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b9606240-2291-4bdc-a503-7eac3546cf4f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:08.166083 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=100 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:08.233678 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-b9606240-2291-4bdc-a503-7eac3546cf4f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lazy-loading 'services' on Instance uuid 09ff322d-f620-4f65-9264-a8ec49efb2b8 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:54:08.305799 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b9606240-2291-4bdc-a503-7eac3546cf4f tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/5e08eb81-68a1-4b94-ac49-5aa93654c6cd" status: 202 len: 0 microversion: 2.1 time: 0.166731 May 26 13:54:08.306382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 500/976] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 13:54:08 2022] DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/5e08eb81-68a1-4b94-ac49-5aa93654c6cd => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:54:08.644507 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fb73745a-c024-4702-bfb9-dae66ec43049 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:08.645112 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fb73745a-c024-4702-bfb9-dae66ec43049 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:08.651644 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb73745a-c024-4702-bfb9-dae66ec43049 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:08.652133 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb73745a-c024-4702-bfb9-dae66ec43049 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:08.652919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb73745a-c024-4702-bfb9-dae66ec43049 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:08.653347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb73745a-c024-4702-bfb9-dae66ec43049 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:08.781213 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fb73745a-c024-4702-bfb9-dae66ec43049 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:08.789242 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fb73745a-c024-4702-bfb9-dae66ec43049 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.148631 May 26 13:54:08.789807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 477/977] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:08 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:09.804512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:09.808779 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fc8f6f59-e26e-4065-8e87-df6881cd3c7d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:09.809467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fc8f6f59-e26e-4065-8e87-df6881cd3c7d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:09.816743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fc8f6f59-e26e-4065-8e87-df6881cd3c7d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:09.817191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fc8f6f59-e26e-4065-8e87-df6881cd3c7d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:09.817949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fc8f6f59-e26e-4065-8e87-df6881cd3c7d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:09.818409 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fc8f6f59-e26e-4065-8e87-df6881cd3c7d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:09.952283 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fc8f6f59-e26e-4065-8e87-df6881cd3c7d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:09.959950 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fc8f6f59-e26e-4065-8e87-df6881cd3c7d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.156890 May 26 13:54:09.960731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 501/978] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:09 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:10.477205 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-12fbe1c7-6908-4dd1-acc7-d30e38b4efa5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:10.477729 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-12fbe1c7-6908-4dd1-acc7-d30e38b4efa5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:10.479702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:10.480398 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:10.486663 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12fbe1c7-6908-4dd1-acc7-d30e38b4efa5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:10.487109 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12fbe1c7-6908-4dd1-acc7-d30e38b4efa5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:10.487935 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12fbe1c7-6908-4dd1-acc7-d30e38b4efa5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:10.488396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-12fbe1c7-6908-4dd1-acc7-d30e38b4efa5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:10.516680 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-12fbe1c7-6908-4dd1-acc7-d30e38b4efa5 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/b9e50b98-4115-4e70-85bc-db55c73342b1" status: 200 len: 194 microversion: 2.1 time: 0.044438 May 26 13:54:10.517183 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 478/979] 10.222.0.16 () {58 vars in 1412 bytes} [Thu May 26 13:54:10 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/b9e50b98-4115-4e70-85bc-db55c73342b1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:10.527677 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b5954482-2a9b-4825-b81b-93fb2309c3e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:10.528201 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b5954482-2a9b-4825-b81b-93fb2309c3e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:10.534297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5954482-2a9b-4825-b81b-93fb2309c3e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:10.535378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5954482-2a9b-4825-b81b-93fb2309c3e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:10.536358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5954482-2a9b-4825-b81b-93fb2309c3e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:10.536802 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5954482-2a9b-4825-b81b-93fb2309c3e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:10.630376 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-b5954482-2a9b-4825-b81b-93fb2309c3e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lazy-loading 'services' on Instance uuid 09ff322d-f620-4f65-9264-a8ec49efb2b8 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:54:10.703371 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b5954482-2a9b-4825-b81b-93fb2309c3e7 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/b9e50b98-4115-4e70-85bc-db55c73342b1" status: 202 len: 0 microversion: 2.1 time: 0.179554 May 26 13:54:10.703987 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 502/980] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 13:54:10 2022] DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments/b9e50b98-4115-4e70-85bc-db55c73342b1 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:54:10.977186 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-437b13c8-9910-4882-b1eb-c5e978a61f04 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:10.977786 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-437b13c8-9910-4882-b1eb-c5e978a61f04 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:10.983678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-437b13c8-9910-4882-b1eb-c5e978a61f04 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:10.984119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-437b13c8-9910-4882-b1eb-c5e978a61f04 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:10.984938 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-437b13c8-9910-4882-b1eb-c5e978a61f04 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:10.985369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-437b13c8-9910-4882-b1eb-c5e978a61f04 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:10.999932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:11.124037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-437b13c8-9910-4882-b1eb-c5e978a61f04 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:11.132497 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-437b13c8-9910-4882-b1eb-c5e978a61f04 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.159243 May 26 13:54:11.133078 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 479/981] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:10 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:11.881614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-071b27fa-37ae-4bcb-9dec-b23a36052466 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:11.882703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-071b27fa-37ae-4bcb-9dec-b23a36052466 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:11.888993 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-071b27fa-37ae-4bcb-9dec-b23a36052466 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:11.889431 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-071b27fa-37ae-4bcb-9dec-b23a36052466 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:11.890204 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-071b27fa-37ae-4bcb-9dec-b23a36052466 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:11.890640 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-071b27fa-37ae-4bcb-9dec-b23a36052466 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:11.919953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-071b27fa-37ae-4bcb-9dec-b23a36052466 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043550 May 26 13:54:11.920545 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 503/982] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:54:11 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:54:12.027642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cc4659c0-6cc4-4ff9-b40b-523c4ef19746 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:12.028536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-cc4659c0-6cc4-4ff9-b40b-523c4ef19746 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:12.036082 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc4659c0-6cc4-4ff9-b40b-523c4ef19746 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.036566 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc4659c0-6cc4-4ff9-b40b-523c4ef19746 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.037349 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc4659c0-6cc4-4ff9-b40b-523c4ef19746 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.037776 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-cc4659c0-6cc4-4ff9-b40b-523c4ef19746 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.066185 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cc4659c0-6cc4-4ff9-b40b-523c4ef19746 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042530 May 26 13:54:12.066846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 480/983] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:54:12 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:54:12.125059 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f62a0dcd-a383-422f-bbec-50d273d09b04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:12.125564 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f62a0dcd-a383-422f-bbec-50d273d09b04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:12.132075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f62a0dcd-a383-422f-bbec-50d273d09b04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.132562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f62a0dcd-a383-422f-bbec-50d273d09b04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.133332 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f62a0dcd-a383-422f-bbec-50d273d09b04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.133778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f62a0dcd-a383-422f-bbec-50d273d09b04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.149894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4e383ee8-8148-4e72-bfca-061a0cf9bd13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:12.150703 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4e383ee8-8148-4e72-bfca-061a0cf9bd13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:12.156668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e383ee8-8148-4e72-bfca-061a0cf9bd13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.157131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e383ee8-8148-4e72-bfca-061a0cf9bd13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.157894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e383ee8-8148-4e72-bfca-061a0cf9bd13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.158442 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4e383ee8-8148-4e72-bfca-061a0cf9bd13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.162120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f62a0dcd-a383-422f-bbec-50d273d09b04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:54:12.255195 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f62a0dcd-a383-422f-bbec-50d273d09b04 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 204 len: 0 microversion: 2.1 time: 0.133538 May 26 13:54:12.258006 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 504/984] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:54:12 2022] DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:54:12.270139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8d121697-9b13-4818-a960-c1e9a05bdc9d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:12.270860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8d121697-9b13-4818-a960-c1e9a05bdc9d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:12.277110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d121697-9b13-4818-a960-c1e9a05bdc9d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.277553 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d121697-9b13-4818-a960-c1e9a05bdc9d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.278391 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d121697-9b13-4818-a960-c1e9a05bdc9d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.278776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8d121697-9b13-4818-a960-c1e9a05bdc9d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.327440 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4e383ee8-8148-4e72-bfca-061a0cf9bd13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:12.337342 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4e383ee8-8148-4e72-bfca-061a0cf9bd13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.191456 May 26 13:54:12.337921 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 481/985] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:12 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:12.425929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8d121697-9b13-4818-a960-c1e9a05bdc9d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:12.433696 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8d121697-9b13-4818-a960-c1e9a05bdc9d tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1675 microversion: 2.1 time: 0.171244 May 26 13:54:12.434274 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 505/986] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:12 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:12.480578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-c407b102-f927-412f-bad1-b637a8be7ffd req-9266faf4-365f-48c7-b9d3-c1fb60fd5d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f0c112-3ce9-43ea-8c2b-421193107cd2", "name": "network-vif-plugged", "status": "completed", "tag": "cedaf787-c283-41ca-8699-4bca18f84374"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:54:12.489222 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-c407b102-f927-412f-bad1-b637a8be7ffd req-9266faf4-365f-48c7-b9d3-c1fb60fd5d11 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:12.489676 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-c407b102-f927-412f-bad1-b637a8be7ffd req-9266faf4-365f-48c7-b9d3-c1fb60fd5d11 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:12.501388 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-c407b102-f927-412f-bad1-b637a8be7ffd req-9266faf4-365f-48c7-b9d3-c1fb60fd5d11 service nova] Creating event network-vif-plugged:cedaf787-c283-41ca-8699-4bca18f84374 for instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 on hv-cinder-81966 May 26 13:54:12.507074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-c407b102-f927-412f-bad1-b637a8be7ffd req-9266faf4-365f-48c7-b9d3-c1fb60fd5d11 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030671 May 26 13:54:12.507679 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 482/987] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:13.357286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ce4ea285-7a0f-4e6d-b806-acf296606a33 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:13.357900 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ce4ea285-7a0f-4e6d-b806-acf296606a33 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:13.364491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ce4ea285-7a0f-4e6d-b806-acf296606a33 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:13.364937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ce4ea285-7a0f-4e6d-b806-acf296606a33 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:13.365700 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ce4ea285-7a0f-4e6d-b806-acf296606a33 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:13.366132 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ce4ea285-7a0f-4e6d-b806-acf296606a33 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:13.452568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-322bbfb4-d353-425d-9063-3348128d682b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:13.453277 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-322bbfb4-d353-425d-9063-3348128d682b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:13.460187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-322bbfb4-d353-425d-9063-3348128d682b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:13.460662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-322bbfb4-d353-425d-9063-3348128d682b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:13.461436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-322bbfb4-d353-425d-9063-3348128d682b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:13.461870 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-322bbfb4-d353-425d-9063-3348128d682b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:13.510077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ce4ea285-7a0f-4e6d-b806-acf296606a33 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:13.517680 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ce4ea285-7a0f-4e6d-b806-acf296606a33 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.164354 May 26 13:54:13.518477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 506/988] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:13 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:13.603399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-322bbfb4-d353-425d-9063-3348128d682b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:13.611098 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-322bbfb4-d353-425d-9063-3348128d682b tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1675 microversion: 2.1 time: 0.163449 May 26 13:54:13.611624 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 483/989] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:13 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:54:14.535604 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6ab5103c-ffae-49fc-bb71-1fac9280e3aa tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:14.536236 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6ab5103c-ffae-49fc-bb71-1fac9280e3aa tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:14.543512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6ab5103c-ffae-49fc-bb71-1fac9280e3aa tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:14.543992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6ab5103c-ffae-49fc-bb71-1fac9280e3aa tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:14.544800 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6ab5103c-ffae-49fc-bb71-1fac9280e3aa tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:14.545240 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6ab5103c-ffae-49fc-bb71-1fac9280e3aa tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:14.629187 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-db4a601f-173d-41dc-b4a0-da864b9ac232 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:14.629833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-db4a601f-173d-41dc-b4a0-da864b9ac232 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:14.636897 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db4a601f-173d-41dc-b4a0-da864b9ac232 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:14.637408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db4a601f-173d-41dc-b4a0-da864b9ac232 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:14.638255 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db4a601f-173d-41dc-b4a0-da864b9ac232 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:14.638915 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-db4a601f-173d-41dc-b4a0-da864b9ac232 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:14.688955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6ab5103c-ffae-49fc-bb71-1fac9280e3aa tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:14.696782 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6ab5103c-ffae-49fc-bb71-1fac9280e3aa tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1265 microversion: 2.1 time: 0.165576 May 26 13:54:14.697682 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 507/990] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:14 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:14.783328 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-db4a601f-173d-41dc-b4a0-da864b9ac232 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:14.791639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-db4a601f-173d-41dc-b4a0-da864b9ac232 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1675 microversion: 2.1 time: 0.166561 May 26 13:54:14.792158 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 484/991] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:14 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:54:15.713737 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-579a0d4d-4d7a-437a-bf89-395c391adb3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:15.714344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-579a0d4d-4d7a-437a-bf89-395c391adb3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:15.721165 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-579a0d4d-4d7a-437a-bf89-395c391adb3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:15.721615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-579a0d4d-4d7a-437a-bf89-395c391adb3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:15.722425 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-579a0d4d-4d7a-437a-bf89-395c391adb3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:15.722916 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-579a0d4d-4d7a-437a-bf89-395c391adb3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:15.809639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a42235c4-bc4b-424c-8681-82a798752b26 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:15.810479 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a42235c4-bc4b-424c-8681-82a798752b26 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:15.818203 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a42235c4-bc4b-424c-8681-82a798752b26 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:15.818651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a42235c4-bc4b-424c-8681-82a798752b26 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:15.819449 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a42235c4-bc4b-424c-8681-82a798752b26 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:15.820068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a42235c4-bc4b-424c-8681-82a798752b26 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:15.901466 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a42235c4-bc4b-424c-8681-82a798752b26 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9958aaa8690c468da2acec47b2bb5f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2007395425194750a87edd6c0da44e66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:15.908245 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-579a0d4d-4d7a-437a-bf89-395c391adb3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:15.912863 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a42235c4-bc4b-424c-8681-82a798752b26 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 200 len: 1607 microversion: 2.1 time: 0.106937 May 26 13:54:15.914054 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 485/992] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:15 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 1607 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:54:15.919647 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-8ed6b540-c293-4508-b4a9-d7f9b4d56156 req-204d2dc7-176d-4490-8661-be9280729f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ff322d-f620-4f65-9264-a8ec49efb2b8", "name": "network-vif-deleted", "tag": "896bf7dd-6b9f-467e-9c56-aa0be50361dc"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:54:15.927862 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-579a0d4d-4d7a-437a-bf89-395c391adb3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1453 microversion: 2.1 time: 0.217847 May 26 13:54:15.930407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 508/993] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:15 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1453 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:54:15.932202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-8ed6b540-c293-4508-b4a9-d7f9b4d56156 req-204d2dc7-176d-4490-8661-be9280729f4e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:15.932757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-8ed6b540-c293-4508-b4a9-d7f9b4d56156 req-204d2dc7-176d-4490-8661-be9280729f4e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:15.949833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-8ed6b540-c293-4508-b4a9-d7f9b4d56156 req-204d2dc7-176d-4490-8661-be9280729f4e service nova] Creating event network-vif-deleted:896bf7dd-6b9f-467e-9c56-aa0be50361dc for instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 on hv-cinder-81966 May 26 13:54:15.953184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ea15256c-8317-4f31-be30-defb0ece7fca tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:15.955596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-8ed6b540-c293-4508-b4a9-d7f9b4d56156 req-204d2dc7-176d-4490-8661-be9280729f4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039454 May 26 13:54:15.956314 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 486/994] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:15.960776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ea15256c-8317-4f31-be30-defb0ece7fca tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:15.969245 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ea15256c-8317-4f31-be30-defb0ece7fca tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:15.969786 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ea15256c-8317-4f31-be30-defb0ece7fca tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:15.970901 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ea15256c-8317-4f31-be30-defb0ece7fca tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:15.971427 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ea15256c-8317-4f31-be30-defb0ece7fca tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:16.124590 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ea15256c-8317-4f31-be30-defb0ece7fca tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:16.133462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ea15256c-8317-4f31-be30-defb0ece7fca tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1453 microversion: 2.1 time: 0.189938 May 26 13:54:16.134141 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 509/995] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:15 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1453 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:54:16.931068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:16.931780 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:16.944555 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:16.945163 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:16.946192 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:16.946700 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:16.961300 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] HTTP exception thrown: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Request method failure captured: May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 HTTP/1.1 May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RbQuwSoyyhHLe1AaWM79ujMzSRxmgiVjqHvbcdP0M9qEu0WtYA9ynH0V4Xygc-JTgl0iV0QQUT21kLF-1i6CWm2BalRTQdaq6oVIEh8lpJ1kMPKs1EQgfIOd7KplEi8K_rdHqoubcf-0uZPgE5YUhIaITva-T3GRn67MwyIvskeFw May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:54:16.963178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2007395425194750a87edd6c0da44e66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2007395425194750a87edd6c0da44e66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 9958aaa8690c468da2acec47b2bb5f23 May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:16.964607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '09ff322d-f620-4f65-9264-a8ec49efb2b8'} May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:16.965690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:16.967017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:16.968643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Returning 404 to user: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:16.968643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-41600895-75c4-4d06-a3d6-2a734c3f64fe tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 404 len: 111 microversion: 2.1 time: 0.038188 May 26 13:54:16.968643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 487/996] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:16 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:16.975344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1f71b0a8-a819-49da-8ca6-fe8bd0d8483a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '.version_select at 0x7f07e057f280>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:16.981492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:16.998794 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1f71b0a8-a819-49da-8ca6-fe8bd0d8483a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132495400" status: 202 len: 0 microversion: 2.1 time: 0.028069 May 26 13:54:16.999366 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 510/997] 10.222.0.16 () {58 vars in 1220 bytes} [Thu May 26 13:54:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132495400 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:54:18.031652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-ef0a4ccd-b2c8-44d5-b441-a91a9e2a0b7a req-0b7e49b7-ff37-4be9-9fa1-29db5c29c718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2f0c112-3ce9-43ea-8c2b-421193107cd2", "tag": "cedaf787-c283-41ca-8699-4bca18f84374"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:54:18.040088 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-ef0a4ccd-b2c8-44d5-b441-a91a9e2a0b7a req-0b7e49b7-ff37-4be9-9fa1-29db5c29c718 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:18.040621 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-ef0a4ccd-b2c8-44d5-b441-a91a9e2a0b7a req-0b7e49b7-ff37-4be9-9fa1-29db5c29c718 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:18.052650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-ef0a4ccd-b2c8-44d5-b441-a91a9e2a0b7a req-0b7e49b7-ff37-4be9-9fa1-29db5c29c718 service nova] Creating event network-changed:cedaf787-c283-41ca-8699-4bca18f84374 for instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 on hv-cinder-81966 May 26 13:54:18.057491 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-ef0a4ccd-b2c8-44d5-b441-a91a9e2a0b7a req-0b7e49b7-ff37-4be9-9fa1-29db5c29c718 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029442 May 26 13:54:18.058056 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 488/998] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:19.949527 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:19.950052 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:19.956015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:19.956787 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:19.957575 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:19.958018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:19.973026 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] HTTP exception thrown: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Request method failure captured: May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 HTTP/1.1 May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RbQuwSoyyhHLe1AaWM79ujMzSRxmgiVjqHvbcdP0M9qEu0WtYA9ynH0V4Xygc-JTgl0iV0QQUT21kLF-1i6CWm2BalRTQdaq6oVIEh8lpJ1kMPKs1EQgfIOd7KplEi8K_rdHqoubcf-0uZPgE5YUhIaITva-T3GRn67MwyIvskeFw May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:54:19.974721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2007395425194750a87edd6c0da44e66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2007395425194750a87edd6c0da44e66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: 9958aaa8690c468da2acec47b2bb5f23 May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:19.976235 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '09ff322d-f620-4f65-9264-a8ec49efb2b8'} May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:19.977139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:19.978539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:19.979944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Returning 404 to user: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:19.979944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3e4a9af7-4eeb-48d4-8b5e-29b8334659ea tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 404 len: 111 microversion: 2.1 time: 0.031506 May 26 13:54:19.979944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 511/999] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:54:19 2022] DELETE /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:19.985864 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:19.986570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 09ff322d-f620-4f65-9264-a8ec49efb2b8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:19.993425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:19.993879 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:19.994651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:19.995095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:20.008518 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] HTTP exception thrown: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Request method failure captured: May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 HTTP/1.1 May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RbQuwSoyyhHLe1AaWM79ujMzSRxmgiVjqHvbcdP0M9qEu0WtYA9ynH0V4Xygc-JTgl0iV0QQUT21kLF-1i6CWm2BalRTQdaq6oVIEh8lpJ1kMPKs1EQgfIOd7KplEi8K_rdHqoubcf-0uZPgE5YUhIaITva-T3GRn67MwyIvskeFw May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:54:20.010146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2007395425194750a87edd6c0da44e66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2007395425194750a87edd6c0da44e66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 9958aaa8690c468da2acec47b2bb5f23 May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:20.011674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '09ff322d-f620-4f65-9264-a8ec49efb2b8'} May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:20.012592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. May 26 13:54:20.014174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:20.015418 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Returning 404 to user: Instance 09ff322d-f620-4f65-9264-a8ec49efb2b8 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:20.015418 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d5629d9c-ba97-4ee2-abb4-70d8809098f3 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8" status: 404 len: 111 microversion: 2.1 time: 0.030295 May 26 13:54:20.015418 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 489/1000] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:19 2022] GET /compute/v2.1/servers/09ff322d-f620-4f65-9264-a8ec49efb2b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:21.146908 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:21.147412 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:21.154434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:21.154884 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:21.155651 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:21.156092 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:21.170124 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] HTTP exception thrown: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Request method failure captured: May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: DELETE /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 HTTP/1.1 May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RbQuwSoyyhHLe1AaWM79ujMzSRxmgiVjqHvbcdP0M9qEu0WtYA9ynH0V4Xygc-JTgl0iV0QQUT21kLF-1i6CWm2BalRTQdaq6oVIEh8lpJ1kMPKs1EQgfIOd7KplEi8K_rdHqoubcf-0uZPgE5YUhIaITva-T3GRn67MwyIvskeFw May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:54:21.171607 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2007395425194750a87edd6c0da44e66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2007395425194750a87edd6c0da44e66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: 9958aaa8690c468da2acec47b2bb5f23 May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.173191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '84b45620-7dd5-4bb5-9da2-e48381d78256'} May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:21.174075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.176150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:21.177601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Returning 404 to user: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:21.177601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-546e2e0c-7d15-4284-89de-d881ee2ba1f1 tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 404 len: 111 microversion: 2.1 time: 0.030214 May 26 13:54:21.177601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 512/1001] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:54:21 2022] DELETE /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:21.182154 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:21.182789 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] [instance: 84b45620-7dd5-4bb5-9da2-e48381d78256] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:21.189425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:21.189873 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:21.190633 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:21.191700 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:21.205263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] HTTP exception thrown: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Request method failure captured: May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 HTTP/1.1 May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RbQuwSoyyhHLe1AaWM79ujMzSRxmgiVjqHvbcdP0M9qEu0WtYA9ynH0V4Xygc-JTgl0iV0QQUT21kLF-1i6CWm2BalRTQdaq6oVIEh8lpJ1kMPKs1EQgfIOd7KplEi8K_rdHqoubcf-0uZPgE5YUhIaITva-T3GRn67MwyIvskeFw May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:54:21.206933 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2007395425194750a87edd6c0da44e66", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2007395425194750a87edd6c0da44e66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2007395425194750a87edd6c0da44e66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 2007395425194750a87edd6c0da44e66 May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1109590207 May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 9958aaa8690c468da2acec47b2bb5f23 May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeTestJSON-1109590207-project May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.208521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '84b45620-7dd5-4bb5-9da2-e48381d78256'} May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:21.209396 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. May 26 13:54:21.210832 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:21.212117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] Returning 404 to user: Instance 84b45620-7dd5-4bb5-9da2-e48381d78256 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:21.212117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ce1471e7-2cac-40bc-83bc-999b9052c85a tempest-AttachVolumeTestJSON-1109590207 tempest-AttachVolumeTestJSON-1109590207-project] 10.222.0.16 "GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256" status: 404 len: 111 microversion: 2.1 time: 0.030005 May 26 13:54:21.212117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 490/1002] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:54:21 2022] GET /compute/v2.1/servers/84b45620-7dd5-4bb5-9da2-e48381d78256 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:25.607075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5e177902-5fca-4d56-953d-87d78bffd025 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Action: 'create', calling method: .version_select at 0x7f07e051c8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-566977033"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:54:25.895572 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5e177902-5fca-4d56-953d-87d78bffd025 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.412204 May 26 13:54:25.896069 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 513/1003] 10.222.0.16 () {60 vars in 1154 bytes} [Thu May 26 13:54:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 413 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 13:54:25.906816 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0258c3c5-513f-4e37-a7cf-0ed4e335a02b tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e04a0d30>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:25.960966 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0258c3c5-513f-4e37-a7cf-0ed4e335a02b tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad" status: 200 len: 344 microversion: 2.1 time: 0.057841 May 26 13:54:25.961534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 491/1004] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:54:25 2022] GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:26.974850 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-acbc17cb-df80-433b-b82e-2727be180941 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e03cf5e0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:27.023836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-acbc17cb-df80-433b-b82e-2727be180941 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad" status: 200 len: 345 microversion: 2.1 time: 0.053972 May 26 13:54:27.024457 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 514/1005] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:54:26 2022] GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:54:27.036575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-50e5011e-c709-42a0-b230-c764ad6cb2dc tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Action: 'create', calling method: .version_select at 0x7f07e043d3a0>, body: {"snapshot": {"volume_id": "6594cf18-137e-468d-888f-d8d0168c91ad", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1877842026"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:54:27.195468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-50e5011e-c709-42a0-b230-c764ad6cb2dc tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.163659 May 26 13:54:27.196058 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 492/1006] 10.222.0.16 () {60 vars in 1161 bytes} [Thu May 26 13:54:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:27.206241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ab719744-745f-443b-9439-ea674dee2375 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e047bc10>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:27.239021 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ab719744-745f-443b-9439-ea674dee2375 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 200 len: 287 microversion: 2.1 time: 0.035843 May 26 13:54:27.239643 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 515/1007] 10.222.0.16 () {58 vars in 1250 bytes} [Thu May 26 13:54:27 2022] GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:27.249613 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-412fdebc-fee5-45c0-a77e-43377afb4c90 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e10bd8b0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:27.279909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-412fdebc-fee5-45c0-a77e-43377afb4c90 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034228 May 26 13:54:27.280525 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 493/1008] 10.222.0.16 () {58 vars in 1139 bytes} [Thu May 26 13:54:27 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:27.291201 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f6c8b6a5-82bf-429b-a772-b46fbb00fca0 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e05be280>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:27.320390 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f6c8b6a5-82bf-429b-a772-b46fbb00fca0 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 200 len: 287 microversion: 2.1 time: 0.032884 May 26 13:54:27.320953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 516/1009] 10.222.0.16 () {58 vars in 1250 bytes} [Thu May 26 13:54:27 2022] GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:54:28.333657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8dfc6aac-b281-4b85-ad0a-48e0f7a6049b tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e042c430>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:28.363058 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8dfc6aac-b281-4b85-ad0a-48e0f7a6049b tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 200 len: 287 microversion: 2.1 time: 0.034196 May 26 13:54:28.363612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 494/1010] 10.222.0.16 () {58 vars in 1250 bytes} [Thu May 26 13:54:28 2022] GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:29.375492 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0d2a500e-431c-47d9-b6a6-02acd6d04a4b tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e04741f0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:29.406241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0d2a500e-431c-47d9-b6a6-02acd6d04a4b tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 200 len: 287 microversion: 2.1 time: 0.035059 May 26 13:54:29.406815 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 517/1011] 10.222.0.16 () {58 vars in 1250 bytes} [Thu May 26 13:54:29 2022] GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:30.418790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-aca9316f-eda8-4ed4-b3d7-2d9bb75d3334 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e0363310>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:30.450798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-aca9316f-eda8-4ed4-b3d7-2d9bb75d3334 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 200 len: 287 microversion: 2.1 time: 0.036320 May 26 13:54:30.451387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 495/1012] 10.222.0.16 () {58 vars in 1250 bytes} [Thu May 26 13:54:30 2022] GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:31.461064 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:31.461972 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:31.465960 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ddaf9815-48b3-4976-8239-e1c51b9126e9 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e057f280>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:31.497448 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ddaf9815-48b3-4976-8239-e1c51b9126e9 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 200 len: 288 microversion: 2.1 time: 0.037596 May 26 13:54:31.498151 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 518/1013] 10.222.0.16 () {58 vars in 1250 bytes} [Thu May 26 13:54:31 2022] GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:31.505328 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:31.506220 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=45 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:54:31.511050 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1c47e263-e221-4401-9103-33e9b5bee086 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e04a09d0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:31.570749 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1c47e263-e221-4401-9103-33e9b5bee086 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 202 len: 0 microversion: 2.1 time: 0.066345 May 26 13:54:31.571445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 496/1014] 10.222.0.16 () {58 vars in 1253 bytes} [Thu May 26 13:54:31 2022] DELETE /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:54:31.579763 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-780d7dd6-2046-4e86-9433-d16bf8454b78 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e0535af0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:31.610466 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-780d7dd6-2046-4e86-9433-d16bf8454b78 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 200 len: 287 microversion: 2.1 time: 0.034443 May 26 13:54:31.611029 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 519/1015] 10.222.0.16 () {58 vars in 1250 bytes} [Thu May 26 13:54:31 2022] GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:32.623388 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-acaef639-9ba4-429c-b503-9734eb3149a9 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e0e56430>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:32.648165 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-acaef639-9ba4-429c-b503-9734eb3149a9 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] HTTP exception thrown: Snapshot 6932f005-b55c-4970-9b7e-bd3bc82d3fc0 could not be found. May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-acaef639-9ba4-429c-b503-9734eb3149a9 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Request method failure captured: May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 HTTP/1.1 May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4aR5S2287xqL-wIYmeD0Y1fwoR6ZwbJGyBp9yDB3hwlmR-hsp9-h6gUi8Fg30EVs3uchl3fuigr1ZPE2TFdeUjQ0jfwl_p8u14mXSbBa0sfpQvuNC0a48JkBaJB-x--mykiA53ogQnsGBXUx_F2sf6CICtw5LLNm8UO2sIiLymEelo May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 7dacce0444d148708e655e3ae6b4d94a May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:54:32.650420 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7dacce0444d148708e655e3ae6b4d94a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 7dacce0444d148708e655e3ae6b4d94a May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesSnapshotsTestJSON-446690949-project May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 9f3865f086ac49b0affe1d7561ca21a1 May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesSnapshotsTestJSON-446690949-project May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Snapshot 6932f005-b55c-4970-9b7e-bd3bc82d3fc0 could not be found. May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '6932f005-b55c-4970-9b7e-bd3bc82d3fc0'} May 26 13:54:32.652015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6932f005-b55c-4970-9b7e-bd3bc82d3fc0 could not be found. (HTTP 404) (Request-ID: req-4eac963e-007d-4514-8d3c-3c94ea8caa01) May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:32.652953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:54:32.654138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6932f005-b55c-4970-9b7e-bd3bc82d3fc0 could not be found. May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 13:54:32.655285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6932f005-b55c-4970-9b7e-bd3bc82d3fc0 could not be found. May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6932f005-b55c-4970-9b7e-bd3bc82d3fc0 could not be found. May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-acaef639-9ba4-429c-b503-9734eb3149a9 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Returning 404 to user: Snapshot 6932f005-b55c-4970-9b7e-bd3bc82d3fc0 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:32.656546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-acaef639-9ba4-429c-b503-9734eb3149a9 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0" status: 404 len: 111 microversion: 2.1 time: 0.033280 May 26 13:54:32.657342 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 497/1016] 10.222.0.16 () {58 vars in 1250 bytes} [Thu May 26 13:54:32 2022] GET /compute/v2.1/os-snapshots/6932f005-b55c-4970-9b7e-bd3bc82d3fc0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:32.661687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5456640e-0748-44b9-bf72-8a5c54cf9d18 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e051c8b0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:32.720442 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5456640e-0748-44b9-bf72-8a5c54cf9d18 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad" status: 202 len: 0 microversion: 2.1 time: 0.063264 May 26 13:54:32.721190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 520/1017] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:54:32 2022] DELETE /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:54:32.730856 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c5527cce-509f-40d9-80aa-6768ac6a84a0 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e0e56af0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:32.777854 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c5527cce-509f-40d9-80aa-6768ac6a84a0 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad" status: 200 len: 344 microversion: 2.1 time: 0.050717 May 26 13:54:32.778418 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 498/1018] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:54:32 2022] GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:33.791998 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-378bf816-0494-4da5-9705-f2a7b12c4477 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e07075e0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:33.819159 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-378bf816-0494-4da5-9705-f2a7b12c4477 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] HTTP exception thrown: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-378bf816-0494-4da5-9705-f2a7b12c4477 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Request method failure captured: May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad HTTP/1.1 May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4aR5S2287xqL-wIYmeD0Y1fwoR6ZwbJGyBp9yDB3hwlmR-hsp9-h6gUi8Fg30EVs3uchl3fuigr1ZPE2TFdeUjQ0jfwl_p8u14mXSbBa0sfpQvuNC0a48JkBaJB-x--mykiA53ogQnsGBXUx_F2sf6CICtw5LLNm8UO2sIiLymEelo May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 7dacce0444d148708e655e3ae6b4d94a May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:54:33.821279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7dacce0444d148708e655e3ae6b4d94a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 7dacce0444d148708e655e3ae6b4d94a May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-VolumesSnapshotsTestJSON-446690949-project May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: 9f3865f086ac49b0affe1d7561ca21a1 May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-VolumesSnapshotsTestJSON-446690949-project May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '6594cf18-137e-468d-888f-d8d0168c91ad'} May 26 13:54:33.822807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. (HTTP 404) (Request-ID: req-12ccdb85-c5d9-4db9-b29b-b19174ba9d92) May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.824129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:54:33.825512 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 13:54:33.826934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-378bf816-0494-4da5-9705-f2a7b12c4477 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Returning 404 to user: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-378bf816-0494-4da5-9705-f2a7b12c4477 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad" status: 404 len: 109 microversion: 2.1 time: 0.035141 May 26 13:54:33.828649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 521/1019] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:54:33 2022] GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:33.833597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29847d95-ab41-43d1-8eed-a3790316c706 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e04228b0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:33.861295 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-29847d95-ab41-43d1-8eed-a3790316c706 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] HTTP exception thrown: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29847d95-ab41-43d1-8eed-a3790316c706 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Request method failure captured: May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad HTTP/1.1 May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4aR5S2287xqL-wIYmeD0Y1fwoR6ZwbJGyBp9yDB3hwlmR-hsp9-h6gUi8Fg30EVs3uchl3fuigr1ZPE2TFdeUjQ0jfwl_p8u14mXSbBa0sfpQvuNC0a48JkBaJB-x--mykiA53ogQnsGBXUx_F2sf6CICtw5LLNm8UO2sIiLymEelo May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 7dacce0444d148708e655e3ae6b4d94a May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:54:33.863285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7dacce0444d148708e655e3ae6b4d94a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 7dacce0444d148708e655e3ae6b4d94a May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesSnapshotsTestJSON-446690949-project May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 9f3865f086ac49b0affe1d7561ca21a1 May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesSnapshotsTestJSON-446690949-project May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '6594cf18-137e-468d-888f-d8d0168c91ad'} May 26 13:54:33.864845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. (HTTP 404) (Request-ID: req-99a7df72-fa4a-4ca0-9534-c1e5225e34d3) May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.865773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 13:54:33.867108 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 13:54:33.868750 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-29847d95-ab41-43d1-8eed-a3790316c706 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Returning 404 to user: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-29847d95-ab41-43d1-8eed-a3790316c706 tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad" status: 404 len: 109 microversion: 2.1 time: 0.036038 May 26 13:54:33.870140 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 499/1020] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:54:33 2022] DELETE /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:33.873279 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-940d0135-2bf1-450d-8e62-85f6a8b24c4d tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Calling method '.version_select at 0x7f07e051cca0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:33.900320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-940d0135-2bf1-450d-8e62-85f6a8b24c4d tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] HTTP exception thrown: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-940d0135-2bf1-450d-8e62-85f6a8b24c4d tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Request method failure captured: May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad HTTP/1.1 May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4aR5S2287xqL-wIYmeD0Y1fwoR6ZwbJGyBp9yDB3hwlmR-hsp9-h6gUi8Fg30EVs3uchl3fuigr1ZPE2TFdeUjQ0jfwl_p8u14mXSbBa0sfpQvuNC0a48JkBaJB-x--mykiA53ogQnsGBXUx_F2sf6CICtw5LLNm8UO2sIiLymEelo May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 7dacce0444d148708e655e3ae6b4d94a May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:54:33.902269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7dacce0444d148708e655e3ae6b4d94a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7dacce0444d148708e655e3ae6b4d94a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 7dacce0444d148708e655e3ae6b4d94a May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-446690949 May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-VolumesSnapshotsTestJSON-446690949-project May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: 9f3865f086ac49b0affe1d7561ca21a1 May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-VolumesSnapshotsTestJSON-446690949-project May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '6594cf18-137e-468d-888f-d8d0168c91ad'} May 26 13:54:33.903669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. (HTTP 404) (Request-ID: req-00e757e1-a81f-4c73-9293-94070f985742) May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.904476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 13:54:33.905601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 13:54:33.906706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-940d0135-2bf1-450d-8e62-85f6a8b24c4d tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] Returning 404 to user: Volume 6594cf18-137e-468d-888f-d8d0168c91ad could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-940d0135-2bf1-450d-8e62-85f6a8b24c4d tempest-VolumesSnapshotsTestJSON-446690949 tempest-VolumesSnapshotsTestJSON-446690949-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad" status: 404 len: 109 microversion: 2.1 time: 0.034226 May 26 13:54:33.907872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 522/1021] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:54:33 2022] GET /compute/v2.1/os-volumes/6594cf18-137e-468d-888f-d8d0168c91ad => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:54:36.640034 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-110d57df-fe34-484d-af31-32d2d362a5e4 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e0363790>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:36.687976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-110d57df-fe34-484d-af31-32d2d362a5e4 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2f69c448-8728-475f-917f-ba8887a0ccdd" status: 200 len: 350 microversion: 2.1 time: 0.052770 May 26 13:54:36.688572 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 500/1022] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:54:36 2022] GET /compute/v2.1/os-volumes/2f69c448-8728-475f-917f-ba8887a0ccdd => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:38.013439 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-781fc107-69a5-42f3-a8e3-27ff28b42c5e tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e04ed700>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:38.062996 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-781fc107-69a5-42f3-a8e3-27ff28b42c5e tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/df829769-66b9-4ce0-a112-cc6b3fc7ec26" status: 200 len: 351 microversion: 2.1 time: 0.054630 May 26 13:54:38.063581 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 523/1023] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:54:38 2022] GET /compute/v2.1/os-volumes/df829769-66b9-4ce0-a112-cc6b3fc7ec26 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:39.408697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-83aa6920-b6dc-4cc8-816e-480fa47f0ef2 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e0e569d0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:39.463642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-83aa6920-b6dc-4cc8-816e-480fa47f0ef2 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/dd07d09e-66d0-4c1d-8f5c-19b1bf00385c" status: 200 len: 351 microversion: 2.1 time: 0.059229 May 26 13:54:39.464240 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 501/1024] 10.222.0.16 () {58 vars in 1244 bytes} [Thu May 26 13:54:39 2022] GET /compute/v2.1/os-volumes/dd07d09e-66d0-4c1d-8f5c-19b1bf00385c => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:39.476467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a92fd571-8588-4bf5-8616-8765cc7fed89 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e04c44c0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:39.601714 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a92fd571-8588-4bf5-8616-8765cc7fed89 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.130018 May 26 13:54:39.602363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 524/1025] 10.222.0.16 () {58 vars in 1133 bytes} [Thu May 26 13:54:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:39.617980 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6d97fc14-80b1-4bb3-86b9-3ff0ff5864f4 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e032b3a0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:39.701237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6d97fc14-80b1-4bb3-86b9-3ff0ff5864f4 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087806 May 26 13:54:39.701811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 502/1026] 10.222.0.16 () {58 vars in 1148 bytes} [Thu May 26 13:54:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:39.716514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-75497b41-b949-4f27-b025-751a488afde0 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e1855e50>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:39.802979 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-75497b41-b949-4f27-b025-751a488afde0 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090521 May 26 13:54:39.803559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 525/1027] 10.222.0.16 () {58 vars in 1133 bytes} [Thu May 26 13:54:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:39.814848 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1b020985-8763-4b30-92ae-15411f32b4bf tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e0346c10>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:39.899051 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1b020985-8763-4b30-92ae-15411f32b4bf tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087786 May 26 13:54:39.899626 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 503/1028] 10.222.0.16 () {58 vars in 1166 bytes} [Thu May 26 13:54:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:39.913870 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-baf19281-939a-4984-909a-d59231417a04 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e062ce50>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:40.002231 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-baf19281-939a-4984-909a-d59231417a04 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093118 May 26 13:54:40.003025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 526/1029] 10.222.0.16 () {58 vars in 1169 bytes} [Thu May 26 13:54:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:40.016018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-aedf5d2d-bf42-4b2e-ac5e-399b512361ef tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e032ba60>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:40.102323 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-aedf5d2d-bf42-4b2e-ac5e-399b512361ef tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090082 May 26 13:54:40.102895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 504/1030] 10.222.0.16 () {58 vars in 1154 bytes} [Thu May 26 13:54:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:40.115024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0770fbfe-c3e2-4040-b60f-8dcff54c571d tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e062cdc0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:40.196030 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0770fbfe-c3e2-4040-b60f-8dcff54c571d tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085809 May 26 13:54:40.196640 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 527/1031] 10.222.0.16 () {58 vars in 1187 bytes} [Thu May 26 13:54:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:40.208448 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0abeebaf-3b36-435d-ba29-3abfcd475589 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] Calling method '.version_select at 0x7f07e0e56ee0>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:40.300387 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0abeebaf-3b36-435d-ba29-3abfcd475589 tempest-VolumesTestJSON-1585001379 tempest-VolumesTestJSON-1585001379-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095675 May 26 13:54:40.301811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 505/1032] 10.222.0.16 () {58 vars in 1154 bytes} [Thu May 26 13:54:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:56.014593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2d56ac50-544d-4bff-8d47-774b3775481f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:56.015672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2d56ac50-544d-4bff-8d47-774b3775481f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:56.022893 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2d56ac50-544d-4bff-8d47-774b3775481f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:56.023389 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2d56ac50-544d-4bff-8d47-774b3775481f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:56.024254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2d56ac50-544d-4bff-8d47-774b3775481f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:56.024776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2d56ac50-544d-4bff-8d47-774b3775481f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:56.060645 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2d56ac50-544d-4bff-8d47-774b3775481f tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051378 May 26 13:54:56.061139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 528/1033] 10.222.0.16 () {60 vars in 1342 bytes} [Thu May 26 13:54:56 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:54:56.125542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8282d4fb-e611-40d1-ab59-e194601044ba tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:56.126146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8282d4fb-e611-40d1-ab59-e194601044ba tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:56.134262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8282d4fb-e611-40d1-ab59-e194601044ba tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:56.134719 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8282d4fb-e611-40d1-ab59-e194601044ba tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:56.135508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8282d4fb-e611-40d1-ab59-e194601044ba tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:56.135951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8282d4fb-e611-40d1-ab59-e194601044ba tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:56.163019 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8282d4fb-e611-40d1-ab59-e194601044ba tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:54:56.248969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8282d4fb-e611-40d1-ab59-e194601044ba tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 204 len: 0 microversion: 2.20 time: 0.127736 May 26 13:54:56.249786 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 506/1034] 10.222.0.16 () {60 vars in 1279 bytes} [Thu May 26 13:54:56 2022] DELETE /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 13:54:56.258668 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:56.259349 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:56.265931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:56.266382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:56.267159 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:56.267597 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:56.607149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:56.616333 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:56.617934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:56.619185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b6fc8740-a139-4666-afb4-220314d7bf42 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.364848 May 26 13:54:56.619851 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 529/1035] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:54:56 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:54:57.641428 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:57.642783 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:57.649961 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:57.650413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:57.651212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:57.651652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:57.895389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:57.905565 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:57.907873 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:57.910035 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-47438ca8-eab1-406e-8b9e-985915b564f2 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1725 microversion: 2.20 time: 0.273183 May 26 13:54:57.910894 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 507/1036] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:54:57 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:54:58.940807 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:54:58.944755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:54:58.958703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:58.959349 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:58.960707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:58.961771 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:59.049352 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-3b26d9b8-6b3b-40b6-b029-10ee2e49ad80 req-70f864c5-3441-4d4c-95dc-d611971e7ccc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aeccb394-4413-411c-a93c-9fbec3f06537", "name": "network-vif-deleted", "tag": "7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:54:59.059550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-3b26d9b8-6b3b-40b6-b029-10ee2e49ad80 req-70f864c5-3441-4d4c-95dc-d611971e7ccc service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:54:59.059998 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-3b26d9b8-6b3b-40b6-b029-10ee2e49ad80 req-70f864c5-3441-4d4c-95dc-d611971e7ccc service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:54:59.074078 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-3b26d9b8-6b3b-40b6-b029-10ee2e49ad80 req-70f864c5-3441-4d4c-95dc-d611971e7ccc service nova] Creating event network-vif-deleted:7bcf2313-de8c-41a1-9fc2-4f6bd644b1aa for instance aeccb394-4413-411c-a93c-9fbec3f06537 on hv-cinder-81966 May 26 13:54:59.080697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-3b26d9b8-6b3b-40b6-b029-10ee2e49ad80 req-70f864c5-3441-4d4c-95dc-d611971e7ccc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034804 May 26 13:54:59.085907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 508/1037] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:54:59.090521 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:59.108657 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:59.110394 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e13f5cad16824554a1fb32ed9a915ae9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ce476b2a1764f56b9780f4a5c75ac3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:54:59.111947 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7fea0fa0-2d4d-4ff5-8ea3-71b84b802a10 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 200 len: 1657 microversion: 2.20 time: 0.177451 May 26 13:54:59.128648 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 530/1038] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:54:58 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 1657 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 13:55:00.136651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:00.137521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:00.148178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:00.148880 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:00.150209 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:00.150931 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:00.169971 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] HTTP exception thrown: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Request method failure captured: May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 HTTP/1.1 May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RK6Q5zvrEcfThxe3m9zcYEAzewaUpJSUecdteBtkN2ABp6CEa_YvmyqibvC62J4VuO176aAYiCSy9P0AJXlsGeND5y5wTScFxIJl_gCIIAwlZa3fyD3YR5E6H-CsG0OivjqsuzG62tMZ1wauGmXmUJVuQ8GpcCymNt9nH1zr5RnLE May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Openstack-Nova-Api-Version: 2.20 May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:55:00.171662 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ce476b2a1764f56b9780f4a5c75ac3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: e13f5cad16824554a1fb32ed9a915ae9 May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:00.173282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'aeccb394-4413-411c-a93c-9fbec3f06537'} May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:55:00.174089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:00.175537 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:00.176738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Returning 404 to user: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:55:00.176738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-37d3e262-cc5b-46f8-8df5-92306971c6fd tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 404 len: 111 microversion: 2.20 time: 0.043411 May 26 13:55:00.176738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 509/1039] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:55:00 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 13:55:00.183539 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ee8b15e2-faef-4255-8772-acdfb3a38436 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '.version_select at 0x7f07e04edaf0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:00.209460 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ee8b15e2-faef-4255-8772-acdfb3a38436 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526375349" status: 204 len: 0 microversion: 2.20 time: 0.029673 May 26 13:55:00.210201 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 531/1040] 10.222.0.16 () {60 vars in 1261 bytes} [Thu May 26 13:55:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526375349 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 13:55:02.083457 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:02.084079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:02.090975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:02.091422 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:02.092186 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:02.092653 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:02.106368 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] HTTP exception thrown: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Request method failure captured: May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 HTTP/1.1 May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RK6Q5zvrEcfThxe3m9zcYEAzewaUpJSUecdteBtkN2ABp6CEa_YvmyqibvC62J4VuO176aAYiCSy9P0AJXlsGeND5y5wTScFxIJl_gCIIAwlZa3fyD3YR5E6H-CsG0OivjqsuzG62tMZ1wauGmXmUJVuQ8GpcCymNt9nH1zr5RnLE May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Openstack-Nova-Api-Version: 2.20 May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:55:02.107890 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ce476b2a1764f56b9780f4a5c75ac3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: e13f5cad16824554a1fb32ed9a915ae9 May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.109528 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'aeccb394-4413-411c-a93c-9fbec3f06537'} May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:55:02.110483 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.111910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:02.113514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Returning 404 to user: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:55:02.113514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-93a6c4bf-5c6a-47d7-8ec6-e8e23582758a tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 404 len: 111 microversion: 2.20 time: 0.029784 May 26 13:55:02.113514 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 510/1041] 10.222.0.16 () {60 vars in 1279 bytes} [Thu May 26 13:55:02 2022] DELETE /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 13:55:02.119482 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:02.120082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: aeccb394-4413-411c-a93c-9fbec3f06537] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:02.126608 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:02.127058 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:02.127811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:02.128240 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:02.141750 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] HTTP exception thrown: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Request method failure captured: May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 HTTP/1.1 May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RK6Q5zvrEcfThxe3m9zcYEAzewaUpJSUecdteBtkN2ABp6CEa_YvmyqibvC62J4VuO176aAYiCSy9P0AJXlsGeND5y5wTScFxIJl_gCIIAwlZa3fyD3YR5E6H-CsG0OivjqsuzG62tMZ1wauGmXmUJVuQ8GpcCymNt9nH1zr5RnLE May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Openstack-Nova-Api-Version: 2.20 May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:55:02.143268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ce476b2a1764f56b9780f4a5c75ac3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: e13f5cad16824554a1fb32ed9a915ae9 May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.145084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'aeccb394-4413-411c-a93c-9fbec3f06537'} May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:55:02.146018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. May 26 13:55:02.147548 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:02.148968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Returning 404 to user: Instance aeccb394-4413-411c-a93c-9fbec3f06537 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:55:02.148968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2e555941-7f99-464b-aaff-016851f496dc tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537" status: 404 len: 111 microversion: 2.20 time: 0.029876 May 26 13:55:02.148968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 532/1042] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:55:02 2022] GET /compute/v2.1/servers/aeccb394-4413-411c-a93c-9fbec3f06537 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 13:55:03.283872 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:03.284406 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:03.291576 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:03.292022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:03.292853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:03.293293 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:03.307445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] HTTP exception thrown: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Request method failure captured: May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 HTTP/1.1 May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4RK6Q5zvrEcfThxe3m9zcYEAzewaUpJSUecdteBtkN2ABp6CEa_YvmyqibvC62J4VuO176aAYiCSy9P0AJXlsGeND5y5wTScFxIJl_gCIIAwlZa3fyD3YR5E6H-CsG0OivjqsuzG62tMZ1wauGmXmUJVuQ8GpcCymNt9nH1zr5RnLE May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Openstack-Nova-Api-Version: 2.20 May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:55:03.309030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ce476b2a1764f56b9780f4a5c75ac3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: e13f5cad16824554a1fb32ed9a915ae9 May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.310709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'ef326f08-0e4f-4ad0-9f62-f4197ccf5b65'} May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:55:03.311568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.312846 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:55:03.314113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Returning 404 to user: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:55:03.314113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-11b40982-12ae-4bf7-b77b-fc79f32e6deb tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 404 len: 111 microversion: 2.20 time: 0.030409 May 26 13:55:03.314113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 511/1043] 10.222.0.16 () {60 vars in 1279 bytes} [Thu May 26 13:55:03 2022] DELETE /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 13:55:03.319258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:03.319868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] [instance: ef326f08-0e4f-4ad0-9f62-f4197ccf5b65] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:03.326620 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:03.327065 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:03.327833 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:03.328261 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:03.344824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] HTTP exception thrown: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Request method failure captured: May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 HTTP/1.1 May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4RK6Q5zvrEcfThxe3m9zcYEAzewaUpJSUecdteBtkN2ABp6CEa_YvmyqibvC62J4VuO176aAYiCSy9P0AJXlsGeND5y5wTScFxIJl_gCIIAwlZa3fyD3YR5E6H-CsG0OivjqsuzG62tMZ1wauGmXmUJVuQ8GpcCymNt9nH1zr5RnLE May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Openstack-Nova-Api-Version: 2.20 May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:55:03.346367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ce476b2a1764f56b9780f4a5c75ac3d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ce476b2a1764f56b9780f4a5c75ac3d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 1ce476b2a1764f56b9780f4a5c75ac3d May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-733003149 May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: e13f5cad16824554a1fb32ed9a915ae9 May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeShelveTestJSON-733003149-project May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.348663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'ef326f08-0e4f-4ad0-9f62-f4197ccf5b65'} May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:55:03.349538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. May 26 13:55:03.351024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:55:03.352342 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] Returning 404 to user: Instance ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:55:03.352342 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b98a4a4b-b4da-4f5f-879a-4a7f32045910 tempest-AttachVolumeShelveTestJSON-733003149 tempest-AttachVolumeShelveTestJSON-733003149-project] 10.222.0.16 "GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65" status: 404 len: 111 microversion: 2.20 time: 0.033246 May 26 13:55:03.352342 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 533/1044] 10.222.0.16 () {60 vars in 1276 bytes} [Thu May 26 13:55:03 2022] GET /compute/v2.1/servers/ef326f08-0e4f-4ad0-9f62-f4197ccf5b65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 13:55:12.607789 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-cc439657-2629-4cb7-8ece-503975173073 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: .version_select at 0x7f07e0522b80>, body: {"keypair": {"name": "tempest-keypair-1035245946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNanD2rS1cat6ctD9n1gmxp8cH87QN5o/4THOjac9dsgyu9ORprGEeULn8U0zkpzxsJERVM3ylouR9Yebz8lkDBB8IX08Y0Jyl7WcxfqI4Dn3Xr5bYugJMzayR/m6rjVRQ=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:55:12.623335 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-cc439657-2629-4cb7-8ece-503975173073 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for project b596535d63d6490eb939c300bfe565cf. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:55:12.628110 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-cc439657-2629-4cb7-8ece-503975173073 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for user ae843854dccd4c28a260d040be460db0 and project b596535d63d6490eb939c300bfe565cf. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:55:12.651962 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-cc439657-2629-4cb7-8ece-503975173073 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187390 May 26 13:55:12.652814 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 512/1045] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:55:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:55:14.036368 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1100646161", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9be8c897-5f1a-4707-b0ba-c3382fad4d2e"}], "security_groups": [{"name": "tempest-securitygroup--2002365964"}], "key_name": "tempest-keypair-1035245946", "user_data": "}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:55:14.043463 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:14.044105 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=22 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:14.151414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.network.neutron [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] validate_networks() for [('9be8c897-5f1a-4707-b0ba-c3382fad4d2e', None, None, None, None, None)] {{(pid=124240) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:55:14.634947 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Flavor limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:55:14.635397 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Image limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:55:14.635860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Flavor pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:55:14.636262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Image pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:55:14.636839 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:55:14.645869 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:14.646408 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:14.647339 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:14.647776 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:14.665074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for project b596535d63d6490eb939c300bfe565cf. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:55:14.669197 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for user ae843854dccd4c28a260d040be460db0 and project b596535d63d6490eb939c300bfe565cf. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:55:14.681558 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Going to run 1 instances... {{(pid=124240) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:55:14.683823 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:55:14.733333 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bd3c7a1f-15e4-432e-93ae-4cec6f95dc1e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.701297 May 26 13:55:14.734331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 534/1046] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:55:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:55:14.745674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-67faadba-be52-4152-9774-211dc699e968 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:14.746264 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-67faadba-be52-4152-9774-211dc699e968 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:14.749240 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:14.808359 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-67faadba-be52-4152-9774-211dc699e968 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:14.815015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-67faadba-be52-4152-9774-211dc699e968 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1242 microversion: 2.1 time: 0.073102 May 26 13:55:14.815599 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 513/1047] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:14 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:15.833161 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-91a3b505-34af-4810-87e5-c802c0f8cdac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:15.834594 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-91a3b505-34af-4810-87e5-c802c0f8cdac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:15.842842 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91a3b505-34af-4810-87e5-c802c0f8cdac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:15.843523 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91a3b505-34af-4810-87e5-c802c0f8cdac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:15.844645 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91a3b505-34af-4810-87e5-c802c0f8cdac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:15.845226 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-91a3b505-34af-4810-87e5-c802c0f8cdac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:15.943018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-91a3b505-34af-4810-87e5-c802c0f8cdac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:15.953019 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-91a3b505-34af-4810-87e5-c802c0f8cdac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1312 microversion: 2.1 time: 0.124252 May 26 13:55:15.953606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 535/1048] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:15 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:16.973983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5755ddbc-30b8-491c-96c8-10301f41030e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:16.974592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5755ddbc-30b8-491c-96c8-10301f41030e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:16.989923 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5755ddbc-30b8-491c-96c8-10301f41030e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:16.990958 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5755ddbc-30b8-491c-96c8-10301f41030e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:16.991928 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5755ddbc-30b8-491c-96c8-10301f41030e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:16.992664 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5755ddbc-30b8-491c-96c8-10301f41030e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:17.236636 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5755ddbc-30b8-491c-96c8-10301f41030e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:17.245106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5755ddbc-30b8-491c-96c8-10301f41030e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1368 microversion: 2.1 time: 0.277279 May 26 13:55:17.245926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 514/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:16 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:17.436445 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-8dad6783-46d3-43be-868e-0a4f77dad5fa req-8613668d-c008-4a60-bd8c-1bdf24bf21d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc7bf48-e03b-4fd7-9e81-3c61c7395271", "tag": "45ae6c26-1a6e-4815-8f09-9250744041ea"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:55:17.468367 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-8dad6783-46d3-43be-868e-0a4f77dad5fa req-8613668d-c008-4a60-bd8c-1bdf24bf21d2 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:17.469206 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-8dad6783-46d3-43be-868e-0a4f77dad5fa req-8613668d-c008-4a60-bd8c-1bdf24bf21d2 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:17.494104 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-8dad6783-46d3-43be-868e-0a4f77dad5fa req-8613668d-c008-4a60-bd8c-1bdf24bf21d2 service nova] Creating event network-changed:45ae6c26-1a6e-4815-8f09-9250744041ea for instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 on hv-cinder-81966 May 26 13:55:17.499941 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-8dad6783-46d3-43be-868e-0a4f77dad5fa req-8613668d-c008-4a60-bd8c-1bdf24bf21d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069094 May 26 13:55:17.501092 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 536/1050] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:55:18.263096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-843fd15a-f565-47a9-8254-4bca6c01a4dd tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:18.263706 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-843fd15a-f565-47a9-8254-4bca6c01a4dd tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:18.270858 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-843fd15a-f565-47a9-8254-4bca6c01a4dd tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:18.271305 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-843fd15a-f565-47a9-8254-4bca6c01a4dd tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:18.272070 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-843fd15a-f565-47a9-8254-4bca6c01a4dd tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:18.272552 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-843fd15a-f565-47a9-8254-4bca6c01a4dd tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:18.408150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-843fd15a-f565-47a9-8254-4bca6c01a4dd tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:18.415795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-843fd15a-f565-47a9-8254-4bca6c01a4dd tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1368 microversion: 2.1 time: 0.156672 May 26 13:55:18.416374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 515/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:18 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:19.433004 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2dae2d89-a70e-4023-ad0a-d89862e76bb6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:19.433618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2dae2d89-a70e-4023-ad0a-d89862e76bb6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:19.440030 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2dae2d89-a70e-4023-ad0a-d89862e76bb6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:19.440517 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2dae2d89-a70e-4023-ad0a-d89862e76bb6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:19.441312 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2dae2d89-a70e-4023-ad0a-d89862e76bb6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:19.441753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2dae2d89-a70e-4023-ad0a-d89862e76bb6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:19.570338 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2dae2d89-a70e-4023-ad0a-d89862e76bb6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:19.578246 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2dae2d89-a70e-4023-ad0a-d89862e76bb6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1368 microversion: 2.1 time: 0.149554 May 26 13:55:19.578816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 537/1052] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:19 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:20.596131 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-97f2638b-f067-490a-bd13-f41b15738f1f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:20.596786 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-97f2638b-f067-490a-bd13-f41b15738f1f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:20.604286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97f2638b-f067-490a-bd13-f41b15738f1f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:20.604781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97f2638b-f067-490a-bd13-f41b15738f1f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:20.605587 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97f2638b-f067-490a-bd13-f41b15738f1f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:20.606030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-97f2638b-f067-490a-bd13-f41b15738f1f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:20.758326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-97f2638b-f067-490a-bd13-f41b15738f1f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:20.767390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-97f2638b-f067-490a-bd13-f41b15738f1f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1368 microversion: 2.1 time: 0.174991 May 26 13:55:20.768016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 516/1053] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:20 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:21.784869 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c739b6cd-672e-4528-b0fc-4a027fea2838 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:21.785555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c739b6cd-672e-4528-b0fc-4a027fea2838 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:21.792417 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c739b6cd-672e-4528-b0fc-4a027fea2838 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:21.792874 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c739b6cd-672e-4528-b0fc-4a027fea2838 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:21.793654 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c739b6cd-672e-4528-b0fc-4a027fea2838 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:21.794166 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c739b6cd-672e-4528-b0fc-4a027fea2838 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:21.927085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c739b6cd-672e-4528-b0fc-4a027fea2838 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:21.934584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c739b6cd-672e-4528-b0fc-4a027fea2838 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1368 microversion: 2.1 time: 0.153675 May 26 13:55:21.935158 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 538/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:21 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:22.685306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-0eae21fe-c8f4-4e39-bdf4-5a652f792fd4 req-9150ec5d-6e9d-4643-980b-7b5fe6c9ec56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc7bf48-e03b-4fd7-9e81-3c61c7395271", "name": "network-vif-plugged", "status": "completed", "tag": "45ae6c26-1a6e-4815-8f09-9250744041ea"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:55:22.695725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-0eae21fe-c8f4-4e39-bdf4-5a652f792fd4 req-9150ec5d-6e9d-4643-980b-7b5fe6c9ec56 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:22.696068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-0eae21fe-c8f4-4e39-bdf4-5a652f792fd4 req-9150ec5d-6e9d-4643-980b-7b5fe6c9ec56 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:22.707908 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-0eae21fe-c8f4-4e39-bdf4-5a652f792fd4 req-9150ec5d-6e9d-4643-980b-7b5fe6c9ec56 service nova] Creating event network-vif-plugged:45ae6c26-1a6e-4815-8f09-9250744041ea for instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 on hv-cinder-81966 May 26 13:55:22.713276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-0eae21fe-c8f4-4e39-bdf4-5a652f792fd4 req-9150ec5d-6e9d-4643-980b-7b5fe6c9ec56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031602 May 26 13:55:22.714019 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 517/1055] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:55:22.954549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-236a5a94-9566-4a22-850f-f98d4beda350 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:22.955148 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-236a5a94-9566-4a22-850f-f98d4beda350 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:22.962857 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-236a5a94-9566-4a22-850f-f98d4beda350 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:22.963408 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-236a5a94-9566-4a22-850f-f98d4beda350 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:22.964326 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-236a5a94-9566-4a22-850f-f98d4beda350 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:22.964846 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-236a5a94-9566-4a22-850f-f98d4beda350 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:23.095531 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-236a5a94-9566-4a22-850f-f98d4beda350 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:23.103662 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-236a5a94-9566-4a22-850f-f98d4beda350 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1368 microversion: 2.1 time: 0.153601 May 26 13:55:23.104255 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 539/1056] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:22 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:24.121429 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bac4a084-c5f4-4d55-95f0-ee5bc4a4ffae tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:24.122127 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bac4a084-c5f4-4d55-95f0-ee5bc4a4ffae tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:24.129014 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac4a084-c5f4-4d55-95f0-ee5bc4a4ffae tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:24.129664 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac4a084-c5f4-4d55-95f0-ee5bc4a4ffae tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:24.130469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac4a084-c5f4-4d55-95f0-ee5bc4a4ffae tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:24.130907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bac4a084-c5f4-4d55-95f0-ee5bc4a4ffae tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:24.263511 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bac4a084-c5f4-4d55-95f0-ee5bc4a4ffae tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:24.272109 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bac4a084-c5f4-4d55-95f0-ee5bc4a4ffae tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1368 microversion: 2.1 time: 0.154838 May 26 13:55:24.272753 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 518/1057] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:24 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:25.291182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fc7ce120-5d62-45f7-8ae1-b66c87f942ed tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:25.291873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fc7ce120-5d62-45f7-8ae1-b66c87f942ed tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:25.294574 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:25.295294 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=6 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:25.301698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fc7ce120-5d62-45f7-8ae1-b66c87f942ed tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:25.302145 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fc7ce120-5d62-45f7-8ae1-b66c87f942ed tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:25.302926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fc7ce120-5d62-45f7-8ae1-b66c87f942ed tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:25.303366 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fc7ce120-5d62-45f7-8ae1-b66c87f942ed tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:25.440342 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fc7ce120-5d62-45f7-8ae1-b66c87f942ed tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:55:25.447759 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fc7ce120-5d62-45f7-8ae1-b66c87f942ed tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1556 microversion: 2.1 time: 0.160799 May 26 13:55:25.448340 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 540/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:55:25 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:55:25.465012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a8259249-beea-4130-89f7-97afb1bd3402 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:55:25.465569 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a8259249-beea-4130-89f7-97afb1bd3402 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:55:25.467461 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:55:25.474106 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8259249-beea-4130-89f7-97afb1bd3402 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:25.474557 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8259249-beea-4130-89f7-97afb1bd3402 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:25.475325 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8259249-beea-4130-89f7-97afb1bd3402 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:25.475777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a8259249-beea-4130-89f7-97afb1bd3402 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:25.554181 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a8259249-beea-4130-89f7-97afb1bd3402 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093006 May 26 13:55:25.554784 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 519/1059] 10.222.0.16 () {58 vars in 1274 bytes} [Thu May 26 13:55:25 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:55:26.481810 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-83abdc41-923f-4d3e-ba0a-160c00524b90 req-df02a824-02ec-4b30-bc4d-dff8f46dc623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcc7bf48-e03b-4fd7-9e81-3c61c7395271", "tag": "45ae6c26-1a6e-4815-8f09-9250744041ea"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:55:26.490313 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-83abdc41-923f-4d3e-ba0a-160c00524b90 req-df02a824-02ec-4b30-bc4d-dff8f46dc623 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:55:26.490764 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-83abdc41-923f-4d3e-ba0a-160c00524b90 req-df02a824-02ec-4b30-bc4d-dff8f46dc623 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:55:26.501591 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-83abdc41-923f-4d3e-ba0a-160c00524b90 req-df02a824-02ec-4b30-bc4d-dff8f46dc623 service nova] Creating event network-changed:45ae6c26-1a6e-4815-8f09-9250744041ea for instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 on hv-cinder-81966 May 26 13:55:26.507226 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-83abdc41-923f-4d3e-ba0a-160c00524b90 req-df02a824-02ec-4b30-bc4d-dff8f46dc623 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029068 May 26 13:55:26.508029 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 541/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:31.126171 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:31.127571 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=30 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:31.132769 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4ba8b7dc-63f4-4ed3-a77e-727a4f09e904 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:31.133265 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4ba8b7dc-63f4-4ed3-a77e-727a4f09e904 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:31.141141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ba8b7dc-63f4-4ed3-a77e-727a4f09e904 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:31.141596 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ba8b7dc-63f4-4ed3-a77e-727a4f09e904 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:31.142383 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ba8b7dc-63f4-4ed3-a77e-727a4f09e904 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:31.142839 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4ba8b7dc-63f4-4ed3-a77e-727a4f09e904 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:31.171862 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4ba8b7dc-63f4-4ed3-a77e-727a4f09e904 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/ips" status: 200 len: 147 microversion: 2.1 time: 0.047588 May 26 13:56:31.172417 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 520/1061] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:56:31 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/ips => generated 147 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:32.532573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:32.533777 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=36 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:32.541299 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dfc67697-d04a-4e16-badd-e38830b22b7e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c88595c-75e8-401e-99e3-0ad7b264cf2e"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:32.543084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dfc67697-d04a-4e16-badd-e38830b22b7e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:32.553135 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfc67697-d04a-4e16-badd-e38830b22b7e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:32.553589 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfc67697-d04a-4e16-badd-e38830b22b7e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:32.554452 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfc67697-d04a-4e16-badd-e38830b22b7e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:32.555301 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dfc67697-d04a-4e16-badd-e38830b22b7e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:32.813466 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dfc67697-d04a-4e16-badd-e38830b22b7e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282740 May 26 13:56:32.814078 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 542/1062] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:56:32 2022] POST /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:33.008116 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d93f06b6-3404-4639-a0fb-90664c27df73 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:33.008658 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d93f06b6-3404-4639-a0fb-90664c27df73 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:33.015137 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d93f06b6-3404-4639-a0fb-90664c27df73 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:33.015581 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d93f06b6-3404-4639-a0fb-90664c27df73 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:33.016400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d93f06b6-3404-4639-a0fb-90664c27df73 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:33.016833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d93f06b6-3404-4639-a0fb-90664c27df73 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:33.042389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d93f06b6-3404-4639-a0fb-90664c27df73 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:56:33.118393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d93f06b6-3404-4639-a0fb-90664c27df73 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 204 len: 0 microversion: 2.1 time: 0.113951 May 26 13:56:33.118984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 521/1063] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:56:33 2022] DELETE /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:56:33.127803 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-82126159-db8e-4efa-b072-d903e074f6ec tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:33.128537 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-82126159-db8e-4efa-b072-d903e074f6ec tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:33.135396 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-82126159-db8e-4efa-b072-d903e074f6ec tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:33.135849 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-82126159-db8e-4efa-b072-d903e074f6ec tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:33.136646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-82126159-db8e-4efa-b072-d903e074f6ec tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:33.137095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-82126159-db8e-4efa-b072-d903e074f6ec tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:33.279388 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-82126159-db8e-4efa-b072-d903e074f6ec tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:33.287764 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-82126159-db8e-4efa-b072-d903e074f6ec tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1578 microversion: 2.1 time: 0.164138 May 26 13:56:33.288356 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 543/1064] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:33 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:34.306341 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d155f936-7b49-43a9-8e66-57bb353acd5b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:34.307025 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d155f936-7b49-43a9-8e66-57bb353acd5b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:34.313527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d155f936-7b49-43a9-8e66-57bb353acd5b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:34.313969 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d155f936-7b49-43a9-8e66-57bb353acd5b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.314724 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d155f936-7b49-43a9-8e66-57bb353acd5b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:34.315150 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d155f936-7b49-43a9-8e66-57bb353acd5b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:34.458570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d155f936-7b49-43a9-8e66-57bb353acd5b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:34.465976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d155f936-7b49-43a9-8e66-57bb353acd5b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1578 microversion: 2.1 time: 0.163876 May 26 13:56:34.466646 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 522/1065] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:34 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:35.483551 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1dee022f-cb4d-4093-85e9-a3532207b91f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:35.484095 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1dee022f-cb4d-4093-85e9-a3532207b91f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:35.490613 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1dee022f-cb4d-4093-85e9-a3532207b91f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.491084 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1dee022f-cb4d-4093-85e9-a3532207b91f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:35.491849 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1dee022f-cb4d-4093-85e9-a3532207b91f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.492283 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1dee022f-cb4d-4093-85e9-a3532207b91f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:35.557654 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-1dee022f-cb4d-4093-85e9-a3532207b91f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:35.565649 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1dee022f-cb4d-4093-85e9-a3532207b91f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 200 len: 1510 microversion: 2.1 time: 0.085972 May 26 13:56:35.567635 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 544/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:35 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 1510 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:35.827306 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-e3166c7e-2e90-4452-b721-a29562a484d4 req-b63f1dd0-b350-4190-8854-0c63d29b7863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2f0c112-3ce9-43ea-8c2b-421193107cd2", "name": "network-vif-deleted", "tag": "cedaf787-c283-41ca-8699-4bca18f84374"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:35.836900 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-e3166c7e-2e90-4452-b721-a29562a484d4 req-b63f1dd0-b350-4190-8854-0c63d29b7863 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:35.837343 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-e3166c7e-2e90-4452-b721-a29562a484d4 req-b63f1dd0-b350-4190-8854-0c63d29b7863 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:35.852137 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-e3166c7e-2e90-4452-b721-a29562a484d4 req-b63f1dd0-b350-4190-8854-0c63d29b7863 service nova] Creating event network-vif-deleted:cedaf787-c283-41ca-8699-4bca18f84374 for instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 on hv-cinder-81966 May 26 13:56:35.858569 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-e3166c7e-2e90-4452-b721-a29562a484d4 req-b63f1dd0-b350-4190-8854-0c63d29b7863 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176783 May 26 13:56:35.859389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 523/1067] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:36.586797 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:36.587412 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:36.594696 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:36.595380 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:36.596283 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:36.596765 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:36.614917 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] HTTP exception thrown: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Request method failure captured: May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 HTTP/1.1 May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4ZX-KNVL4bl-_ODI3RHYmU_cx3-FHO3GzBS0_m729ZTFxo6mFOiPrkaPwcF1XMnYpFWwM2JbSYLxFR0vsbWcIY2HyO1_HKuCTa4snoYm876U0FPEWZRNPezQVIM6ZdCib0jOgum03tyQfuTBflGZJf0B-HqywGna7yi69czg0v6dOQ May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-TestVolumeBootPattern-1168914393 May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 13:56:36.616621 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_189885bf9a5944bf8eaedd89bb5bec9f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-TestVolumeBootPattern-1168914393 May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-TestVolumeBootPattern-1168914393 May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-TestVolumeBootPattern-1168914393-project May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: f98684788906448bb3b35af5a2fc017f May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-TestVolumeBootPattern-1168914393-project May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 13:56:36.618189 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'a2f0c112-3ce9-43ea-8c2b-421193107cd2'} May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:56:36.619264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 13:56:36.620871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 13:56:36.622241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Returning 404 to user: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:56:36.622241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a46dc3b5-aaee-4b65-b247-4bb463f0199f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 404 len: 111 microversion: 2.1 time: 0.036149 May 26 13:56:36.622241 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 545/1068] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:36 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:56:36.720359 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1278883946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-18808065", "security_groups": [{"name": "tempest-secgroup-smoke-1175980800"}], "block_device_mapping_v2": [{"uuid": "0b0e09b7-79f7-4a1a-8710-03604dc7e80c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f13feac7-9894-4fb0-8d65-5458a77bde4c"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:36.840158 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] validate_networks() for [('f13feac7-9894-4fb0-8d65-5458a77bde4c', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:56:37.297253 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:56:37.297672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:56:37.298137 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:56:37.298542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:56:37.298942 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:56:37.307853 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:37.308226 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:37.309043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:37.309469 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:37.325592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Getting quotas for project 189885bf9a5944bf8eaedd89bb5bec9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:37.330012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Getting quotas for user f98684788906448bb3b35af5a2fc017f and project 189885bf9a5944bf8eaedd89bb5bec9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:37.390435 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:56:37.392926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b0e09b7-79f7-4a1a-8710-03604dc7e80c',volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:56:37.545285 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a254ba2e-c3a8-48b9-a78d-a2340d74156b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829328 May 26 13:56:37.547064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 524/1069] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:56:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:56:37.556547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6abe9c40-5d2d-459a-af3d-35cd6ae3bd69 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:37.557160 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6abe9c40-5d2d-459a-af3d-35cd6ae3bd69 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:37.612636 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6abe9c40-5d2d-459a-af3d-35cd6ae3bd69 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:37.619796 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6abe9c40-5d2d-459a-af3d-35cd6ae3bd69 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1093 microversion: 2.1 time: 0.067021 May 26 13:56:37.621140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 546/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:37 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:38.638583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-27dc1ef6-590a-4794-b3f5-f35635ab6832 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:38.639198 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-27dc1ef6-590a-4794-b3f5-f35635ab6832 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:38.647589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27dc1ef6-590a-4794-b3f5-f35635ab6832 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:38.648036 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27dc1ef6-590a-4794-b3f5-f35635ab6832 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:38.648870 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27dc1ef6-590a-4794-b3f5-f35635ab6832 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:38.649277 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27dc1ef6-590a-4794-b3f5-f35635ab6832 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:38.727611 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-27dc1ef6-590a-4794-b3f5-f35635ab6832 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:38.735403 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-27dc1ef6-590a-4794-b3f5-f35635ab6832 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1209 microversion: 2.1 time: 0.101103 May 26 13:56:38.736103 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 525/1071] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:38 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:39.756182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-92f1cd5d-de85-4b12-a875-04c098ba70dc tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:39.757011 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-92f1cd5d-de85-4b12-a875-04c098ba70dc tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:39.765199 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-92f1cd5d-de85-4b12-a875-04c098ba70dc tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.765199 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-92f1cd5d-de85-4b12-a875-04c098ba70dc tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.766558 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-92f1cd5d-de85-4b12-a875-04c098ba70dc tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:39.767009 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-92f1cd5d-de85-4b12-a875-04c098ba70dc tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:39.915956 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-92f1cd5d-de85-4b12-a875-04c098ba70dc tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:39.927672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-92f1cd5d-de85-4b12-a875-04c098ba70dc tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1277 microversion: 2.1 time: 0.176039 May 26 13:56:39.928250 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 547/1072] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:39 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:40.384337 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-380dd538-4a3e-4567-8f7f-4173b7c441f4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: .version_select at 0x7f07e0457ee0>, body: {"keypair": {"name": "tempest-keypair-1644725720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+WjiPtShUiBkoHmlneycPLpHKyc61Rfsy6SLe/lrb0qbh7irWrSEpigvJuYgMEBamyuIq8BXz5Czxf+eJ3Zu6f99I9arS3Rn4V/AeKGiDRj4pHnJqjsykh4QWr/mBTTg=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:40.406657 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-380dd538-4a3e-4567-8f7f-4173b7c441f4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for project b596535d63d6490eb939c300bfe565cf. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:40.413792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-380dd538-4a3e-4567-8f7f-4173b7c441f4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for user ae843854dccd4c28a260d040be460db0 and project b596535d63d6490eb939c300bfe565cf. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:40.427007 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-2a6f7c45-ea8b-4f09-949f-b23c943f0114 req-b332a683-cd04-47ee-b666-5c829896c37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542be9eb-1123-48c5-a719-6f0ab71e41f8", "tag": "4051c928-b3ec-4074-8a3e-df0e1508b5a0"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:40.453047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-2a6f7c45-ea8b-4f09-949f-b23c943f0114 req-b332a683-cd04-47ee-b666-5c829896c37a service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.454438 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-2a6f7c45-ea8b-4f09-949f-b23c943f0114 req-b332a683-cd04-47ee-b666-5c829896c37a service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.473107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-2a6f7c45-ea8b-4f09-949f-b23c943f0114 req-b332a683-cd04-47ee-b666-5c829896c37a service nova] Creating event network-changed:4051c928-b3ec-4074-8a3e-df0e1508b5a0 for instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 on hv-cinder-81966 May 26 13:56:40.476532 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-380dd538-4a3e-4567-8f7f-4173b7c441f4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096039 May 26 13:56:40.477755 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 526/1073] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:56:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:40.482703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-2a6f7c45-ea8b-4f09-949f-b23c943f0114 req-b332a683-cd04-47ee-b666-5c829896c37a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060902 May 26 13:56:40.483705 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 548/1074] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:56:40.945910 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0ca08ef8-4f28-490e-9e6f-855b89bfeb13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:40.946623 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0ca08ef8-4f28-490e-9e6f-855b89bfeb13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:40.954476 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ca08ef8-4f28-490e-9e6f-855b89bfeb13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.954923 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ca08ef8-4f28-490e-9e6f-855b89bfeb13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:40.955704 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ca08ef8-4f28-490e-9e6f-855b89bfeb13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:40.956138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0ca08ef8-4f28-490e-9e6f-855b89bfeb13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:41.137342 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0ca08ef8-4f28-490e-9e6f-855b89bfeb13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:41.145477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0ca08ef8-4f28-490e-9e6f-855b89bfeb13 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.204645 May 26 13:56:41.146074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 527/1075] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:40 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:42.164408 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dc941dfd-5145-402a-8db3-73261da5d438 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:42.165242 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dc941dfd-5145-402a-8db3-73261da5d438 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:42.171789 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc941dfd-5145-402a-8db3-73261da5d438 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.172763 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc941dfd-5145-402a-8db3-73261da5d438 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.173909 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc941dfd-5145-402a-8db3-73261da5d438 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.174957 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc941dfd-5145-402a-8db3-73261da5d438 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.359065 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1415725727", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9be8c897-5f1a-4707-b0ba-c3382fad4d2e"}], "security_groups": [{"name": "tempest-securitygroup--1262772306"}], "key_name": "tempest-keypair-1644725720", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:42.361772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dc941dfd-5145-402a-8db3-73261da5d438 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:42.370525 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dc941dfd-5145-402a-8db3-73261da5d438 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.211298 May 26 13:56:42.371118 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 549/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:42 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:42.479959 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] validate_networks() for [('9be8c897-5f1a-4707-b0ba-c3382fad4d2e', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:56:42.867290 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:56:42.867714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:56:42.868206 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:56:42.868640 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:56:42.869052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:56:42.877819 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.878262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.879757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:42.880283 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:42.897971 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for project b596535d63d6490eb939c300bfe565cf. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:56:42.902053 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for user ae843854dccd4c28a260d040be460db0 and project b596535d63d6490eb939c300bfe565cf. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:56:42.913400 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:56:42.915563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:56:42.964931 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-8fb53be8-7e2d-4301-9f61-70770cf82bec tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614465 May 26 13:56:42.965585 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 528/1077] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:56:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:56:42.975937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-37d72fc8-8fdb-405a-b302-7a4cc7be6472 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:42.976583 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-37d72fc8-8fdb-405a-b302-7a4cc7be6472 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:43.034008 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-37d72fc8-8fdb-405a-b302-7a4cc7be6472 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:43.041678 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-37d72fc8-8fdb-405a-b302-7a4cc7be6472 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1242 microversion: 2.1 time: 0.069681 May 26 13:56:43.042149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 550/1078] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:42 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:43.396544 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-a527ee39-4b94-42e0-baef-c1665e7b8a36 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:43.397580 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-a527ee39-4b94-42e0-baef-c1665e7b8a36 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:43.405453 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a527ee39-4b94-42e0-baef-c1665e7b8a36 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.406051 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a527ee39-4b94-42e0-baef-c1665e7b8a36 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.406836 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a527ee39-4b94-42e0-baef-c1665e7b8a36 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:43.407312 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-a527ee39-4b94-42e0-baef-c1665e7b8a36 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:43.564803 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-a527ee39-4b94-42e0-baef-c1665e7b8a36 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:43.573170 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-a527ee39-4b94-42e0-baef-c1665e7b8a36 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.181963 May 26 13:56:43.583206 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 529/1079] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:43 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:44.059309 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-da26ee74-d756-4529-aef2-3452da05c79d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:44.059854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-da26ee74-d756-4529-aef2-3452da05c79d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:44.067768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-da26ee74-d756-4529-aef2-3452da05c79d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.068334 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-da26ee74-d756-4529-aef2-3452da05c79d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.069195 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-da26ee74-d756-4529-aef2-3452da05c79d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.069727 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-da26ee74-d756-4529-aef2-3452da05c79d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.134798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-da26ee74-d756-4529-aef2-3452da05c79d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:44.142401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-da26ee74-d756-4529-aef2-3452da05c79d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1300 microversion: 2.1 time: 0.088194 May 26 13:56:44.143063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 551/1080] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:44 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:44.590490 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-82366e8a-b75d-4b0d-baa8-1769719ed6bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:44.591091 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-82366e8a-b75d-4b0d-baa8-1769719ed6bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:44.597727 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82366e8a-b75d-4b0d-baa8-1769719ed6bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.598432 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82366e8a-b75d-4b0d-baa8-1769719ed6bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:44.599168 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82366e8a-b75d-4b0d-baa8-1769719ed6bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:44.599570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-82366e8a-b75d-4b0d-baa8-1769719ed6bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.058152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-82366e8a-b75d-4b0d-baa8-1769719ed6bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:45.065925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-82366e8a-b75d-4b0d-baa8-1769719ed6bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.479241 May 26 13:56:45.067105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 530/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:44 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:45.159038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c09f7ed6-71a4-47ff-850c-7977226c4135 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:45.159604 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c09f7ed6-71a4-47ff-850c-7977226c4135 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:45.166177 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c09f7ed6-71a4-47ff-850c-7977226c4135 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.166832 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c09f7ed6-71a4-47ff-850c-7977226c4135 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.167595 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c09f7ed6-71a4-47ff-850c-7977226c4135 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.168023 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c09f7ed6-71a4-47ff-850c-7977226c4135 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.305785 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c09f7ed6-71a4-47ff-850c-7977226c4135 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:45.313291 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c09f7ed6-71a4-47ff-850c-7977226c4135 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1368 microversion: 2.1 time: 0.158172 May 26 13:56:45.314228 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 552/1082] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:45 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:45.704672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-daf3f5ae-d4f2-47b1-8f49-cc3a443971ba req-2652ca75-de0f-40a5-8eb8-073753726101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70", "tag": "1bd62356-0f14-4a52-893b-e92247ad2950"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:45.718577 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-daf3f5ae-d4f2-47b1-8f49-cc3a443971ba req-2652ca75-de0f-40a5-8eb8-073753726101 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:45.719373 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-daf3f5ae-d4f2-47b1-8f49-cc3a443971ba req-2652ca75-de0f-40a5-8eb8-073753726101 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:45.756226 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-daf3f5ae-d4f2-47b1-8f49-cc3a443971ba req-2652ca75-de0f-40a5-8eb8-073753726101 service nova] Creating event network-changed:1bd62356-0f14-4a52-893b-e92247ad2950 for instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 on hv-cinder-81966 May 26 13:56:45.766272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-daf3f5ae-d4f2-47b1-8f49-cc3a443971ba req-2652ca75-de0f-40a5-8eb8-073753726101 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068871 May 26 13:56:45.766904 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 531/1083] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:46.089085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fddae1e6-e9f5-445e-a7d1-14f0f92dd011 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:46.090083 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fddae1e6-e9f5-445e-a7d1-14f0f92dd011 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:46.099096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fddae1e6-e9f5-445e-a7d1-14f0f92dd011 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.099667 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fddae1e6-e9f5-445e-a7d1-14f0f92dd011 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.100848 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fddae1e6-e9f5-445e-a7d1-14f0f92dd011 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.101293 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fddae1e6-e9f5-445e-a7d1-14f0f92dd011 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.245644 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fddae1e6-e9f5-445e-a7d1-14f0f92dd011 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:46.253543 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fddae1e6-e9f5-445e-a7d1-14f0f92dd011 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.171623 May 26 13:56:46.254713 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 553/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:46 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:46.331727 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fb57abcd-d583-4037-92f2-fd68e92272cc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:46.332451 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fb57abcd-d583-4037-92f2-fd68e92272cc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:46.338791 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb57abcd-d583-4037-92f2-fd68e92272cc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.339238 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb57abcd-d583-4037-92f2-fd68e92272cc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.340001 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb57abcd-d583-4037-92f2-fd68e92272cc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:46.340476 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fb57abcd-d583-4037-92f2-fd68e92272cc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:46.474042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fb57abcd-d583-4037-92f2-fd68e92272cc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:46.481699 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fb57abcd-d583-4037-92f2-fd68e92272cc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1368 microversion: 2.1 time: 0.154441 May 26 13:56:46.482281 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 532/1085] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:46 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:47.271190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-986399c4-bdcd-4d04-a88f-30e53c184f9e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:47.271904 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-986399c4-bdcd-4d04-a88f-30e53c184f9e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:47.278459 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-986399c4-bdcd-4d04-a88f-30e53c184f9e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.278897 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-986399c4-bdcd-4d04-a88f-30e53c184f9e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.279647 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-986399c4-bdcd-4d04-a88f-30e53c184f9e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.280072 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-986399c4-bdcd-4d04-a88f-30e53c184f9e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.416289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-986399c4-bdcd-4d04-a88f-30e53c184f9e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.424000 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-986399c4-bdcd-4d04-a88f-30e53c184f9e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.156769 May 26 13:56:47.424614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 554/1086] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:47 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:47.499013 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f298ffe9-2c35-46f2-8df1-5f9d5f271659 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:47.499723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f298ffe9-2c35-46f2-8df1-5f9d5f271659 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:47.506579 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f298ffe9-2c35-46f2-8df1-5f9d5f271659 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.507058 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f298ffe9-2c35-46f2-8df1-5f9d5f271659 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.507834 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f298ffe9-2c35-46f2-8df1-5f9d5f271659 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:47.508277 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f298ffe9-2c35-46f2-8df1-5f9d5f271659 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:47.648664 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f298ffe9-2c35-46f2-8df1-5f9d5f271659 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:47.656290 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f298ffe9-2c35-46f2-8df1-5f9d5f271659 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1368 microversion: 2.1 time: 0.161138 May 26 13:56:47.656906 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 533/1087] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:47 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:48.442816 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ee530588-9331-429f-b1b9-299523171584 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:48.443529 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ee530588-9331-429f-b1b9-299523171584 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:48.450187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee530588-9331-429f-b1b9-299523171584 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.450641 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee530588-9331-429f-b1b9-299523171584 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.451485 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee530588-9331-429f-b1b9-299523171584 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.451918 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee530588-9331-429f-b1b9-299523171584 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.595729 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-ee530588-9331-429f-b1b9-299523171584 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:48.603707 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ee530588-9331-429f-b1b9-299523171584 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.165519 May 26 13:56:48.604281 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 555/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:48 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:48.673616 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-52ae35db-4ffd-4214-841a-e40505c1ec44 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:48.674212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-52ae35db-4ffd-4214-841a-e40505c1ec44 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:48.681251 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52ae35db-4ffd-4214-841a-e40505c1ec44 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.681705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52ae35db-4ffd-4214-841a-e40505c1ec44 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.682535 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52ae35db-4ffd-4214-841a-e40505c1ec44 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:48.682974 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-52ae35db-4ffd-4214-841a-e40505c1ec44 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:48.813610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-52ae35db-4ffd-4214-841a-e40505c1ec44 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:48.821584 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-52ae35db-4ffd-4214-841a-e40505c1ec44 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1368 microversion: 2.1 time: 0.151958 May 26 13:56:48.822152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 534/1089] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:48 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:49.620882 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-19eed5c9-07fe-4bcb-bac3-7108ad961dc8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:49.621470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-19eed5c9-07fe-4bcb-bac3-7108ad961dc8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:49.628247 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-19eed5c9-07fe-4bcb-bac3-7108ad961dc8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.629140 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-19eed5c9-07fe-4bcb-bac3-7108ad961dc8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.629911 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-19eed5c9-07fe-4bcb-bac3-7108ad961dc8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.630347 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-19eed5c9-07fe-4bcb-bac3-7108ad961dc8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.765568 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-19eed5c9-07fe-4bcb-bac3-7108ad961dc8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.773148 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-19eed5c9-07fe-4bcb-bac3-7108ad961dc8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.156475 May 26 13:56:49.773726 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 556/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:49 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:49.839160 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2c003242-0d65-4d26-8e08-5336ac9a4196 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:49.839781 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2c003242-0d65-4d26-8e08-5336ac9a4196 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:49.846240 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c003242-0d65-4d26-8e08-5336ac9a4196 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.846680 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c003242-0d65-4d26-8e08-5336ac9a4196 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.848063 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c003242-0d65-4d26-8e08-5336ac9a4196 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:49.848491 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2c003242-0d65-4d26-8e08-5336ac9a4196 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:49.980606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2c003242-0d65-4d26-8e08-5336ac9a4196 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:49.989246 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2c003242-0d65-4d26-8e08-5336ac9a4196 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1368 microversion: 2.1 time: 0.153844 May 26 13:56:49.989844 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 535/1091] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:49 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:50.789763 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d3bd6ea8-1e51-4302-89c4-d08da50f8035 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:50.790359 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d3bd6ea8-1e51-4302-89c4-d08da50f8035 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:50.796624 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d3bd6ea8-1e51-4302-89c4-d08da50f8035 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.797074 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d3bd6ea8-1e51-4302-89c4-d08da50f8035 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.797849 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d3bd6ea8-1e51-4302-89c4-d08da50f8035 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:50.798281 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d3bd6ea8-1e51-4302-89c4-d08da50f8035 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:50.943331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d3bd6ea8-1e51-4302-89c4-d08da50f8035 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:50.950877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d3bd6ea8-1e51-4302-89c4-d08da50f8035 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.164979 May 26 13:56:50.951458 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 557/1092] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:50 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:51.006756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bc045d57-2a4c-4dbd-ad2f-d138f6b9e71c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:51.007326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bc045d57-2a4c-4dbd-ad2f-d138f6b9e71c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:51.013985 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc045d57-2a4c-4dbd-ad2f-d138f6b9e71c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.014510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc045d57-2a4c-4dbd-ad2f-d138f6b9e71c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.015325 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc045d57-2a4c-4dbd-ad2f-d138f6b9e71c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.015926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bc045d57-2a4c-4dbd-ad2f-d138f6b9e71c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.161956 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bc045d57-2a4c-4dbd-ad2f-d138f6b9e71c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:51.169407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bc045d57-2a4c-4dbd-ad2f-d138f6b9e71c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1368 microversion: 2.1 time: 0.167019 May 26 13:56:51.169976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 536/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:51 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:51.547677 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-eb003cdd-e49d-4218-a2fc-8b9869226212 req-409a5293-1d9c-40b5-8c25-099fd413e031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70", "name": "network-vif-plugged", "status": "completed", "tag": "1bd62356-0f14-4a52-893b-e92247ad2950"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:51.556216 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-eb003cdd-e49d-4218-a2fc-8b9869226212 req-409a5293-1d9c-40b5-8c25-099fd413e031 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.556780 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-eb003cdd-e49d-4218-a2fc-8b9869226212 req-409a5293-1d9c-40b5-8c25-099fd413e031 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.568132 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-eb003cdd-e49d-4218-a2fc-8b9869226212 req-409a5293-1d9c-40b5-8c25-099fd413e031 service nova] Creating event network-vif-plugged:1bd62356-0f14-4a52-893b-e92247ad2950 for instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 on hv-cinder-81966 May 26 13:56:51.576378 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-eb003cdd-e49d-4218-a2fc-8b9869226212 req-409a5293-1d9c-40b5-8c25-099fd413e031 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092131 May 26 13:56:51.577619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 558/1094] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:51.968393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ab4d34a6-db77-4017-aa24-0deaa29fd6ee tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:51.969002 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab4d34a6-db77-4017-aa24-0deaa29fd6ee tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:51.975075 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab4d34a6-db77-4017-aa24-0deaa29fd6ee tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.975519 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab4d34a6-db77-4017-aa24-0deaa29fd6ee tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:51.976286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab4d34a6-db77-4017-aa24-0deaa29fd6ee tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:51.976743 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab4d34a6-db77-4017-aa24-0deaa29fd6ee tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.115768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ab4d34a6-db77-4017-aa24-0deaa29fd6ee tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:52.124416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ab4d34a6-db77-4017-aa24-0deaa29fd6ee tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.159829 May 26 13:56:52.125109 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 537/1095] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:51 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:52.187995 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-6923fabf-7e3e-4cc4-bbe2-4e2c1030362f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:52.188747 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-6923fabf-7e3e-4cc4-bbe2-4e2c1030362f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:52.195627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6923fabf-7e3e-4cc4-bbe2-4e2c1030362f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:52.196073 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6923fabf-7e3e-4cc4-bbe2-4e2c1030362f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.196861 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6923fabf-7e3e-4cc4-bbe2-4e2c1030362f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:52.197294 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-6923fabf-7e3e-4cc4-bbe2-4e2c1030362f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:52.326004 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-6923fabf-7e3e-4cc4-bbe2-4e2c1030362f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:52.333997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-6923fabf-7e3e-4cc4-bbe2-4e2c1030362f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1368 microversion: 2.1 time: 0.150685 May 26 13:56:52.334574 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 559/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:52 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:53.142138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7f209b46-9e3e-436e-ba28-11e890618dd9 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:53.142744 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7f209b46-9e3e-436e-ba28-11e890618dd9 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:53.145246 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=4 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:53.145902 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=16 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:53.152441 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f209b46-9e3e-436e-ba28-11e890618dd9 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.152889 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f209b46-9e3e-436e-ba28-11e890618dd9 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.153654 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f209b46-9e3e-436e-ba28-11e890618dd9 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.154089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7f209b46-9e3e-436e-ba28-11e890618dd9 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.287308 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-7f209b46-9e3e-436e-ba28-11e890618dd9 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:53.290790 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:53.296095 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7f209b46-9e3e-436e-ba28-11e890618dd9 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.157840 May 26 13:56:53.296715 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 538/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:53 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:53.351155 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-72e763bd-17e2-44a3-9bad-19e104f99734 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:53.351755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-72e763bd-17e2-44a3-9bad-19e104f99734 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:53.353787 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=4 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:53.359640 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-72e763bd-17e2-44a3-9bad-19e104f99734 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.360082 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-72e763bd-17e2-44a3-9bad-19e104f99734 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.360864 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-72e763bd-17e2-44a3-9bad-19e104f99734 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.361285 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-72e763bd-17e2-44a3-9bad-19e104f99734 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.493296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-72e763bd-17e2-44a3-9bad-19e104f99734 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:53.500670 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-72e763bd-17e2-44a3-9bad-19e104f99734 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1368 microversion: 2.1 time: 0.153436 May 26 13:56:53.501230 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 560/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:53 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:53.601574 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-55acc897-13a7-4427-a86b-9f5d875853f7 req-9377d3c7-94f4-4a11-8ed3-163c05a4d4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542be9eb-1123-48c5-a719-6f0ab71e41f8", "name": "network-vif-plugged", "status": "completed", "tag": "4051c928-b3ec-4074-8a3e-df0e1508b5a0"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:53.610629 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-55acc897-13a7-4427-a86b-9f5d875853f7 req-9377d3c7-94f4-4a11-8ed3-163c05a4d4ba service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:53.611066 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-55acc897-13a7-4427-a86b-9f5d875853f7 req-9377d3c7-94f4-4a11-8ed3-163c05a4d4ba service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:53.624421 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-55acc897-13a7-4427-a86b-9f5d875853f7 req-9377d3c7-94f4-4a11-8ed3-163c05a4d4ba service nova] Creating event network-vif-plugged:4051c928-b3ec-4074-8a3e-df0e1508b5a0 for instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 on hv-cinder-81966 May 26 13:56:53.634815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-55acc897-13a7-4427-a86b-9f5d875853f7 req-9377d3c7-94f4-4a11-8ed3-163c05a4d4ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032349 May 26 13:56:53.634815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 539/1099] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:54.313395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-32ae8afc-6999-4252-a245-649c5de7c20e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:54.314032 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-32ae8afc-6999-4252-a245-649c5de7c20e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:54.320028 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32ae8afc-6999-4252-a245-649c5de7c20e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.320511 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32ae8afc-6999-4252-a245-649c5de7c20e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.321259 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32ae8afc-6999-4252-a245-649c5de7c20e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.321694 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32ae8afc-6999-4252-a245-649c5de7c20e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.325542 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:56:54.470266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-32ae8afc-6999-4252-a245-649c5de7c20e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.478470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-32ae8afc-6999-4252-a245-649c5de7c20e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.168889 May 26 13:56:54.479042 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 561/1100] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:54 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:54.520350 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-24ade12f-7f07-47ff-b929-aff8fad39019 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:54.521056 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-24ade12f-7f07-47ff-b929-aff8fad39019 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:54.527061 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24ade12f-7f07-47ff-b929-aff8fad39019 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.527504 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24ade12f-7f07-47ff-b929-aff8fad39019 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.528280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24ade12f-7f07-47ff-b929-aff8fad39019 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.528742 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24ade12f-7f07-47ff-b929-aff8fad39019 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.658648 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-24ade12f-7f07-47ff-b929-aff8fad39019 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:54.667124 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-24ade12f-7f07-47ff-b929-aff8fad39019 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1556 microversion: 2.1 time: 0.152461 May 26 13:56:54.667718 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 540/1101] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:54 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:54.683407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-1d781047-e3a9-45ec-afb0-b98687a2debb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:54.683903 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-1d781047-e3a9-45ec-afb0-b98687a2debb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:54.690408 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1d781047-e3a9-45ec-afb0-b98687a2debb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.690933 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1d781047-e3a9-45ec-afb0-b98687a2debb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.691626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1d781047-e3a9-45ec-afb0-b98687a2debb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:54.692056 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-1d781047-e3a9-45ec-afb0-b98687a2debb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:54.770096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-1d781047-e3a9-45ec-afb0-b98687a2debb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089732 May 26 13:56:54.770700 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 562/1102] 10.222.0.16 () {58 vars in 1274 bytes} [Thu May 26 13:56:54 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:55.496017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5ddcd14f-52d1-4013-ae89-2208620ba810 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:55.496659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5ddcd14f-52d1-4013-ae89-2208620ba810 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:55.502884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ddcd14f-52d1-4013-ae89-2208620ba810 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.503340 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ddcd14f-52d1-4013-ae89-2208620ba810 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.504190 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ddcd14f-52d1-4013-ae89-2208620ba810 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.504666 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5ddcd14f-52d1-4013-ae89-2208620ba810 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.647827 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-5ddcd14f-52d1-4013-ae89-2208620ba810 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:55.655435 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5ddcd14f-52d1-4013-ae89-2208620ba810 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1265 microversion: 2.1 time: 0.163419 May 26 13:56:55.656012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 541/1103] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:55 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:55.748646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-66f05269-4d6b-4325-9da3-e375940d0df6 req-35e6d5b6-f8f1-4a2b-a27a-7cb606e16e0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70", "tag": "1bd62356-0f14-4a52-893b-e92247ad2950"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:55.756829 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-66f05269-4d6b-4325-9da3-e375940d0df6 req-35e6d5b6-f8f1-4a2b-a27a-7cb606e16e0f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:55.757272 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-66f05269-4d6b-4325-9da3-e375940d0df6 req-35e6d5b6-f8f1-4a2b-a27a-7cb606e16e0f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:55.769388 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-66f05269-4d6b-4325-9da3-e375940d0df6 req-35e6d5b6-f8f1-4a2b-a27a-7cb606e16e0f service nova] Creating event network-changed:1bd62356-0f14-4a52-893b-e92247ad2950 for instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 on hv-cinder-81966 May 26 13:56:55.774432 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-66f05269-4d6b-4325-9da3-e375940d0df6 req-35e6d5b6-f8f1-4a2b-a27a-7cb606e16e0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029979 May 26 13:56:55.775022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 563/1104] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:56:56.673291 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-198576cc-865a-4655-ba5b-10c50c2c1158 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:56.673829 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-198576cc-865a-4655-ba5b-10c50c2c1158 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:56.681135 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-198576cc-865a-4655-ba5b-10c50c2c1158 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.681630 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-198576cc-865a-4655-ba5b-10c50c2c1158 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.682402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-198576cc-865a-4655-ba5b-10c50c2c1158 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.682864 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-198576cc-865a-4655-ba5b-10c50c2c1158 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.825691 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-198576cc-865a-4655-ba5b-10c50c2c1158 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:56.834221 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-198576cc-865a-4655-ba5b-10c50c2c1158 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1452 microversion: 2.1 time: 0.164998 May 26 13:56:56.834792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 542/1105] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:56 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:56:56.851953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7793acf1-0cbd-4f48-b91f-6a5f7ddda161 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:56:56.852676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7793acf1-0cbd-4f48-b91f-6a5f7ddda161 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:56:56.858823 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7793acf1-0cbd-4f48-b91f-6a5f7ddda161 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.859270 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7793acf1-0cbd-4f48-b91f-6a5f7ddda161 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.860030 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7793acf1-0cbd-4f48-b91f-6a5f7ddda161 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:56.860494 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7793acf1-0cbd-4f48-b91f-6a5f7ddda161 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:56.996075 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7793acf1-0cbd-4f48-b91f-6a5f7ddda161 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:56:57.004361 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7793acf1-0cbd-4f48-b91f-6a5f7ddda161 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1452 microversion: 2.1 time: 0.157521 May 26 13:56:57.005632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 564/1106] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:56:56 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:56:58.633595 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-80f361b2-0a41-4a12-bdbe-eccb5d1bc956 req-61112b05-4c8d-49d7-b86b-1ae21e278b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542be9eb-1123-48c5-a719-6f0ab71e41f8", "tag": "4051c928-b3ec-4074-8a3e-df0e1508b5a0"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:56:58.642768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-80f361b2-0a41-4a12-bdbe-eccb5d1bc956 req-61112b05-4c8d-49d7-b86b-1ae21e278b6d service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:56:58.643530 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-80f361b2-0a41-4a12-bdbe-eccb5d1bc956 req-61112b05-4c8d-49d7-b86b-1ae21e278b6d service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:56:58.655646 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-80f361b2-0a41-4a12-bdbe-eccb5d1bc956 req-61112b05-4c8d-49d7-b86b-1ae21e278b6d service nova] Creating event network-changed:4051c928-b3ec-4074-8a3e-df0e1508b5a0 for instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 on hv-cinder-81966 May 26 13:56:58.661472 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-80f361b2-0a41-4a12-bdbe-eccb5d1bc956 req-61112b05-4c8d-49d7-b86b-1ae21e278b6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031782 May 26 13:56:58.662111 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 543/1107] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:58:03.646425 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 13:58:03.647089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Thu May 26 13:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 13:58:10.696265 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=50 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:10.697198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=16 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:10.701346 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-731aebf0-b157-4495-8da5-94e845e90218 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:10.701840 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-731aebf0-b157-4495-8da5-94e845e90218 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:10.709077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-731aebf0-b157-4495-8da5-94e845e90218 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:10.709531 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-731aebf0-b157-4495-8da5-94e845e90218 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:10.710312 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-731aebf0-b157-4495-8da5-94e845e90218 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:10.710745 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-731aebf0-b157-4495-8da5-94e845e90218 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:10.734702 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-731aebf0-b157-4495-8da5-94e845e90218 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70/ips" status: 200 len: 147 microversion: 2.1 time: 0.040272 May 26 13:58:10.735277 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 565/1108] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:58:10 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70/ips => generated 147 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:58:10.745231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:10.745959 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=22 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:10.751399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c88595c-75e8-401e-99e3-0ad7b264cf2e"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:10.752883 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:10.761690 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:10.762146 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:10.762936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:10.763378 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:10.848815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Invalid volume: volume 1c88595c-75e8-401e-99e3-0ad7b264cf2e is already attached to instances: bcc7bf48-e03b-4fd7-9e81-3c61c7395271 May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: POST /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70/os-volume_attachments HTTP/1.1 May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 74 May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:58:10.850541 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {"volumeAttachment": {"volumeId": "1c88595c-75e8-401e-99e3-0ad7b264cf2e"}} May 26 13:58:10.852178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Invalid volume: volume 1c88595c-75e8-401e-99e3-0ad7b264cf2e is already attached to instances: bcc7bf48-e03b-4fd7-9e81-3c61c7395271 May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'server_id': 'aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70', 'body': {'volumeAttachment': {'volumeId': '1c88595c-75e8-401e-99e3-0ad7b264cf2e'}}} May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1c88595c-75e8-401e-99e3-0ad7b264cf2e is already attached to instances: bcc7bf48-e03b-4fd7-9e81-3c61c7395271 May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:10.853153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1c88595c-75e8-401e-99e3-0ad7b264cf2e is already attached to instances: bcc7bf48-e03b-4fd7-9e81-3c61c7395271 May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:10.854390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:10.855634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:10.855634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:58:10.855634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:58:10.855634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1c88595c-75e8-401e-99e3-0ad7b264cf2e is already attached to instances: bcc7bf48-e03b-4fd7-9e81-3c61c7395271 May 26 13:58:10.855634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:10.855634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 400 to user: Invalid volume: volume 1c88595c-75e8-401e-99e3-0ad7b264cf2e is already attached to instances: bcc7bf48-e03b-4fd7-9e81-3c61c7395271 {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:58:10.855634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7c212809-5198-44aa-b879-3928acd4808e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109105 May 26 13:58:10.855634 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 544/1109] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:58:10 2022] POST /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 13:58:10.860758 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e80d2d91-491b-4fc9-a29c-303175c95fe7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:10.861261 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e80d2d91-491b-4fc9-a29c-303175c95fe7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:10.868286 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e80d2d91-491b-4fc9-a29c-303175c95fe7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:10.868760 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e80d2d91-491b-4fc9-a29c-303175c95fe7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:10.869538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e80d2d91-491b-4fc9-a29c-303175c95fe7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:10.869972 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e80d2d91-491b-4fc9-a29c-303175c95fe7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:10.894825 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e80d2d91-491b-4fc9-a29c-303175c95fe7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:58:10.983289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e80d2d91-491b-4fc9-a29c-303175c95fe7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 204 len: 0 microversion: 2.1 time: 0.125751 May 26 13:58:10.984027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 566/1110] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:58:10 2022] DELETE /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:58:10.992788 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f1db0925-5359-4bec-b121-a190a9f8a86b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:10.993508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f1db0925-5359-4bec-b121-a190a9f8a86b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:11.001900 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1db0925-5359-4bec-b121-a190a9f8a86b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:11.002344 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1db0925-5359-4bec-b121-a190a9f8a86b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:11.003674 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1db0925-5359-4bec-b121-a190a9f8a86b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:11.004417 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f1db0925-5359-4bec-b121-a190a9f8a86b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:11.145714 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-f1db0925-5359-4bec-b121-a190a9f8a86b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:11.153425 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f1db0925-5359-4bec-b121-a190a9f8a86b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1680 microversion: 2.1 time: 0.165037 May 26 13:58:11.153995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 545/1111] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:10 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:12.171719 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e4542917-4fec-4f86-8479-83f6793c0dee tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:12.172359 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e4542917-4fec-4f86-8479-83f6793c0dee tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:12.179297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4542917-4fec-4f86-8479-83f6793c0dee tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:12.179750 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4542917-4fec-4f86-8479-83f6793c0dee tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:12.180554 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4542917-4fec-4f86-8479-83f6793c0dee tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:12.180988 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e4542917-4fec-4f86-8479-83f6793c0dee tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:12.322264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e4542917-4fec-4f86-8479-83f6793c0dee tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:12.330382 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e4542917-4fec-4f86-8479-83f6793c0dee tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1680 microversion: 2.1 time: 0.162902 May 26 13:58:12.330973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 567/1112] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:12 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:13.350519 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-4061a9dd-67de-4372-b111-ef1e1d0e4f93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:13.351237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-4061a9dd-67de-4372-b111-ef1e1d0e4f93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:13.358316 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4061a9dd-67de-4372-b111-ef1e1d0e4f93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:13.358760 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4061a9dd-67de-4372-b111-ef1e1d0e4f93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:13.359556 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4061a9dd-67de-4372-b111-ef1e1d0e4f93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:13.359991 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-4061a9dd-67de-4372-b111-ef1e1d0e4f93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:13.434550 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-4061a9dd-67de-4372-b111-ef1e1d0e4f93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:13.445973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-4061a9dd-67de-4372-b111-ef1e1d0e4f93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 200 len: 1612 microversion: 2.1 time: 0.100426 May 26 13:58:13.447042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 546/1113] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:13 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 1612 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:13.626927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-cd55fb7a-553a-45f9-a7eb-efb09a0907d1 req-688e43b6-3281-4641-8204-4e0f43f3250c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70", "name": "network-vif-deleted", "tag": "1bd62356-0f14-4a52-893b-e92247ad2950"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:13.637375 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-cd55fb7a-553a-45f9-a7eb-efb09a0907d1 req-688e43b6-3281-4641-8204-4e0f43f3250c service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:13.637618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-cd55fb7a-553a-45f9-a7eb-efb09a0907d1 req-688e43b6-3281-4641-8204-4e0f43f3250c service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:13.650076 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-cd55fb7a-553a-45f9-a7eb-efb09a0907d1 req-688e43b6-3281-4641-8204-4e0f43f3250c service nova] Creating event network-vif-deleted:1bd62356-0f14-4a52-893b-e92247ad2950 for instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 on hv-cinder-81966 May 26 13:58:13.655208 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-cd55fb7a-553a-45f9-a7eb-efb09a0907d1 req-688e43b6-3281-4641-8204-4e0f43f3250c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032146 May 26 13:58:13.659116 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 568/1114] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:58:14.464618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:14.465265 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:14.472671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:14.473119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:14.474545 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:14.475278 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:14.490040 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 HTTP/1.1 May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:58:14.491602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 13:58:14.493101 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70'} May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:58:14.494162 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 13:58:14.495416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:14.496583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:58:14.496583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2f0722b2-b746-4b32-a9b0-cca839010d26 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 404 len: 111 microversion: 2.1 time: 0.032767 May 26 13:58:14.496583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 547/1115] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:14 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:58:14.502706 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7e4a7cc4-c141-466f-be64-1f3f813d3ccf tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '.version_select at 0x7f07e057fa60>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:14.524920 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7e4a7cc4-c141-466f-be64-1f3f813d3ccf tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644725720" status: 202 len: 0 microversion: 2.1 time: 0.026298 May 26 13:58:14.525505 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 569/1116] 10.222.0.16 () {58 vars in 1220 bytes} [Thu May 26 13:58:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644725720 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:58:15.454364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e592647f-ed43-49b1-b969-f84363c21017 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:15.454926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e592647f-ed43-49b1-b969-f84363c21017 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:15.461874 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e592647f-ed43-49b1-b969-f84363c21017 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:15.462316 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e592647f-ed43-49b1-b969-f84363c21017 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:15.463074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e592647f-ed43-49b1-b969-f84363c21017 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:15.463509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e592647f-ed43-49b1-b969-f84363c21017 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:15.543995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-e592647f-ed43-49b1-b969-f84363c21017 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lazy-loading 'services' on Instance uuid bcc7bf48-e03b-4fd7-9e81-3c61c7395271 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 13:58:15.614637 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e592647f-ed43-49b1-b969-f84363c21017 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-volume_attachments/1c88595c-75e8-401e-99e3-0ad7b264cf2e" status: 202 len: 0 microversion: 2.1 time: 0.163963 May 26 13:58:15.615265 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 548/1117] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 13:58:15 2022] DELETE /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-volume_attachments/1c88595c-75e8-401e-99e3-0ad7b264cf2e => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:58:15.624020 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-97c982f8-a5b2-48a7-b364-329fc9665cda tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:15.625106 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-97c982f8-a5b2-48a7-b364-329fc9665cda tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:15.632867 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97c982f8-a5b2-48a7-b364-329fc9665cda tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:15.633569 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97c982f8-a5b2-48a7-b364-329fc9665cda tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:15.634519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97c982f8-a5b2-48a7-b364-329fc9665cda tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:15.634954 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-97c982f8-a5b2-48a7-b364-329fc9665cda tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:15.669384 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-97c982f8-a5b2-48a7-b364-329fc9665cda tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049772 May 26 13:58:15.669949 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 570/1118] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:58:15 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:58:16.682320 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bd83152e-38cb-4550-9df0-34010d16fe24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:16.683404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bd83152e-38cb-4550-9df0-34010d16fe24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:16.689673 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd83152e-38cb-4550-9df0-34010d16fe24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:16.690118 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd83152e-38cb-4550-9df0-34010d16fe24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:16.691119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd83152e-38cb-4550-9df0-34010d16fe24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:16.691635 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-bd83152e-38cb-4550-9df0-34010d16fe24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:16.722570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bd83152e-38cb-4550-9df0-34010d16fe24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044387 May 26 13:58:16.723318 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 549/1119] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 13:58:16 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 13:58:16.781739 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0ecc80f8-0a5a-40b9-a2ee-cfe5bbec8a0a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:16.782264 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0ecc80f8-0a5a-40b9-a2ee-cfe5bbec8a0a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:16.789489 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ecc80f8-0a5a-40b9-a2ee-cfe5bbec8a0a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:16.789938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ecc80f8-0a5a-40b9-a2ee-cfe5bbec8a0a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:16.790704 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ecc80f8-0a5a-40b9-a2ee-cfe5bbec8a0a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:16.791136 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ecc80f8-0a5a-40b9-a2ee-cfe5bbec8a0a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:16.815984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0ecc80f8-0a5a-40b9-a2ee-cfe5bbec8a0a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 13:58:16.907414 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0ecc80f8-0a5a-40b9-a2ee-cfe5bbec8a0a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 204 len: 0 microversion: 2.1 time: 0.129188 May 26 13:58:16.908021 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 571/1120] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 13:58:16 2022] DELETE /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 13:58:16.916706 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-ab858fe5-74e3-48cd-bf1b-9bb856af182e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:16.917369 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-ab858fe5-74e3-48cd-bf1b-9bb856af182e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:16.923466 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab858fe5-74e3-48cd-bf1b-9bb856af182e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:16.923905 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab858fe5-74e3-48cd-bf1b-9bb856af182e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:16.924706 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab858fe5-74e3-48cd-bf1b-9bb856af182e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:16.925196 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-ab858fe5-74e3-48cd-bf1b-9bb856af182e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:17.056275 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-ab858fe5-74e3-48cd-bf1b-9bb856af182e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:17.063860 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-ab858fe5-74e3-48cd-bf1b-9bb856af182e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1680 microversion: 2.1 time: 0.151224 May 26 13:58:17.064457 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 550/1121] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:16 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:18.083067 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-2898f3df-8fda-4ffd-b4e0-e5a38628471f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:18.083676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-2898f3df-8fda-4ffd-b4e0-e5a38628471f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:18.090102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2898f3df-8fda-4ffd-b4e0-e5a38628471f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:18.090549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2898f3df-8fda-4ffd-b4e0-e5a38628471f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:18.091311 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2898f3df-8fda-4ffd-b4e0-e5a38628471f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:18.091743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-2898f3df-8fda-4ffd-b4e0-e5a38628471f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:18.219187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-2898f3df-8fda-4ffd-b4e0-e5a38628471f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:18.228667 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-2898f3df-8fda-4ffd-b4e0-e5a38628471f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1680 microversion: 2.1 time: 0.150139 May 26 13:58:18.229250 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 572/1122] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:18 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:19.254087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-446e9888-027b-40dc-95d5-beafad8a0eeb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:19.255229 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-446e9888-027b-40dc-95d5-beafad8a0eeb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:19.264774 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-446e9888-027b-40dc-95d5-beafad8a0eeb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:19.265471 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-446e9888-027b-40dc-95d5-beafad8a0eeb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:19.266678 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-446e9888-027b-40dc-95d5-beafad8a0eeb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:19.267355 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-446e9888-027b-40dc-95d5-beafad8a0eeb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:19.337952 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-446e9888-027b-40dc-95d5-beafad8a0eeb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:19.345561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-446e9888-027b-40dc-95d5-beafad8a0eeb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 200 len: 1612 microversion: 2.1 time: 0.100380 May 26 13:58:19.346144 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 551/1123] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:19 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 1612 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:19.495089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-9fe3380d-3205-4d6f-9d39-789e2e5a109c req-ecda6b81-ffb6-416d-8d3f-dc2c1b892e92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcc7bf48-e03b-4fd7-9e81-3c61c7395271", "name": "network-vif-deleted", "tag": "45ae6c26-1a6e-4815-8f09-9250744041ea"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:19.507040 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-9fe3380d-3205-4d6f-9d39-789e2e5a109c req-ecda6b81-ffb6-416d-8d3f-dc2c1b892e92 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:19.507915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-9fe3380d-3205-4d6f-9d39-789e2e5a109c req-ecda6b81-ffb6-416d-8d3f-dc2c1b892e92 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:19.521614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-9fe3380d-3205-4d6f-9d39-789e2e5a109c req-ecda6b81-ffb6-416d-8d3f-dc2c1b892e92 service nova] Creating event network-vif-deleted:45ae6c26-1a6e-4815-8f09-9250744041ea for instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 on hv-cinder-81966 May 26 13:58:19.527582 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-9fe3380d-3205-4d6f-9d39-789e2e5a109c req-ecda6b81-ffb6-416d-8d3f-dc2c1b892e92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036866 May 26 13:58:19.528192 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 573/1124] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:58:20.363897 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:20.364559 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:20.370723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:20.371167 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:20.371930 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:20.372393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:20.386981 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 HTTP/1.1 May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:58:20.388668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 13:58:20.391527 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'bcc7bf48-e03b-4fd7-9e81-3c61c7395271'} May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:58:20.392347 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 13:58:20.394841 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:58:20.397082 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:58:20.397082 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-305b9219-679b-4610-8faa-89d03a77456a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 404 len: 111 microversion: 2.1 time: 0.031012 May 26 13:58:20.397082 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 552/1125] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:20 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 13:58:20.402981 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-12793d67-5907-4a13-b472-ea91c4a1205b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '.version_select at 0x7f07e057fa60>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:20.420409 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-12793d67-5907-4a13-b472-ea91c4a1205b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035245946" status: 202 len: 0 microversion: 2.1 time: 0.021528 May 26 13:58:20.420937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 574/1126] 10.222.0.16 () {58 vars in 1220 bytes} [Thu May 26 13:58:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035245946 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 13:58:21.349957 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bf992393-0203-4a26-b33a-20907e68bcbc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: .version_select at 0x7f07e02191f0>, body: {"keypair": {"name": "tempest-keypair-892430461", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu6h4M8A0BPo95Ssq/ETxjZWaqpmzoPCuRWNeq+KHhdxDA9n6Lf9l6YeOMs1vROMvVcc5zN9meH35lCC/6pb+rfheQiQJ3dNfks3x+wg3QQgm50FzrtpKQ/E0lRD2DLgw=="}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:21.364652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-bf992393-0203-4a26-b33a-20907e68bcbc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for project b596535d63d6490eb939c300bfe565cf. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:58:21.368603 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-bf992393-0203-4a26-b33a-20907e68bcbc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for user ae843854dccd4c28a260d040be460db0 and project b596535d63d6490eb939c300bfe565cf. Resources: {'key_pairs'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:58:21.390990 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bf992393-0203-4a26-b33a-20907e68bcbc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045683 May 26 13:58:21.391597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 553/1127] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 13:58:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:58:22.738795 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1245909402", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9be8c897-5f1a-4707-b0ba-c3382fad4d2e"}], "security_groups": [{"name": "tempest-securitygroup--457938685"}], "key_name": "tempest-keypair-892430461", "user_data": "}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:22.842526 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.network.neutron [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] validate_networks() for [('9be8c897-5f1a-4707-b0ba-c3382fad4d2e', None, None, None, None, None)] {{(pid=124240) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:58:23.212578 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Flavor limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:58:23.213019 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Image limits 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:58:23.213519 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Flavor pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:58:23.213948 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Image pref 0:0:0 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:58:23.214359 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.virt.hardware [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:58:23.223493 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:23.223929 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:23.224755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:23.225191 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:23.242181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for project b596535d63d6490eb939c300bfe565cf. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:58:23.246137 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for user ae843854dccd4c28a260d040be460db0 and project b596535d63d6490eb939c300bfe565cf. Resources: {'instances', 'cores', 'ram'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:58:23.257906 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Going to run 1 instances... {{(pid=124240) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:58:23.260258 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:58:23.304555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR oslo.messaging._drivers.impl_rabbit [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [0f1dcd68-d194-4ccb-a125-7efa04037a61] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 13:58:24.312672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO oslo.messaging._drivers.impl_rabbit [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [0f1dcd68-d194-4ccb-a125-7efa04037a61] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 56994. May 26 13:58:24.317045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-384004a4-2acf-4f46-9368-1f45e2e407e7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.583282 May 26 13:58:24.317576 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 575/1128] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:58:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:58:24.328222 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-dfee1945-0c66-4498-97dd-cefe20047716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:24.328865 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-dfee1945-0c66-4498-97dd-cefe20047716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:24.387620 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-dfee1945-0c66-4498-97dd-cefe20047716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:24.399302 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-dfee1945-0c66-4498-97dd-cefe20047716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1241 microversion: 2.1 time: 0.075395 May 26 13:58:24.399889 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 554/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:24 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:25.417204 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-24049319-e60e-4d61-b502-812eb6e4a80f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:25.417845 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-24049319-e60e-4d61-b502-812eb6e4a80f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:25.424127 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-24049319-e60e-4d61-b502-812eb6e4a80f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:25.424614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-24049319-e60e-4d61-b502-812eb6e4a80f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:25.426223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-24049319-e60e-4d61-b502-812eb6e4a80f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:25.426659 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-24049319-e60e-4d61-b502-812eb6e4a80f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:25.490658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-24049319-e60e-4d61-b502-812eb6e4a80f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:25.498281 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-24049319-e60e-4d61-b502-812eb6e4a80f tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1299 microversion: 2.1 time: 0.085387 May 26 13:58:25.498860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 576/1130] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:25 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:26.515867 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eea24ecf-e213-4709-981e-a1d8d165f5e1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:26.516513 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eea24ecf-e213-4709-981e-a1d8d165f5e1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:26.524141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eea24ecf-e213-4709-981e-a1d8d165f5e1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:26.525043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eea24ecf-e213-4709-981e-a1d8d165f5e1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:26.526005 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eea24ecf-e213-4709-981e-a1d8d165f5e1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:26.526443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eea24ecf-e213-4709-981e-a1d8d165f5e1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:26.755318 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-8195f182-343c-4c3c-a5f7-5e0f23fa6d11 req-09c20983-e057-4939-be14-b17d129618fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c048a6df-4889-4011-a072-70b3c965b14e", "tag": "8a8f4660-4941-4d34-ba99-bfe395f333c5"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:26.766384 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-8195f182-343c-4c3c-a5f7-5e0f23fa6d11 req-09c20983-e057-4939-be14-b17d129618fe service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:26.767100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-8195f182-343c-4c3c-a5f7-5e0f23fa6d11 req-09c20983-e057-4939-be14-b17d129618fe service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:26.780650 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-8195f182-343c-4c3c-a5f7-5e0f23fa6d11 req-09c20983-e057-4939-be14-b17d129618fe service nova] Creating event network-changed:8a8f4660-4941-4d34-ba99-bfe395f333c5 for instance c048a6df-4889-4011-a072-70b3c965b14e on hv-cinder-81966 May 26 13:58:26.786727 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-8195f182-343c-4c3c-a5f7-5e0f23fa6d11 req-09c20983-e057-4939-be14-b17d129618fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035865 May 26 13:58:26.788230 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 577/1131] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 13:58:26.813896 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eea24ecf-e213-4709-981e-a1d8d165f5e1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:26.827431 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eea24ecf-e213-4709-981e-a1d8d165f5e1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1366 microversion: 2.1 time: 0.315996 May 26 13:58:26.836668 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 555/1132] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:26 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:27.847148 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5461cac9-79c8-4580-b5ae-5e6841052ddc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:27.847845 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5461cac9-79c8-4580-b5ae-5e6841052ddc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:27.854299 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5461cac9-79c8-4580-b5ae-5e6841052ddc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:27.854780 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5461cac9-79c8-4580-b5ae-5e6841052ddc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:27.855573 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5461cac9-79c8-4580-b5ae-5e6841052ddc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:27.856012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5461cac9-79c8-4580-b5ae-5e6841052ddc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:27.995667 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-5461cac9-79c8-4580-b5ae-5e6841052ddc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:28.003944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5461cac9-79c8-4580-b5ae-5e6841052ddc tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1366 microversion: 2.1 time: 0.160996 May 26 13:58:28.004562 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 578/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:27 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:58:29.021240 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-43a404ee-7a70-4354-8bea-712b22575993 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:29.021971 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-43a404ee-7a70-4354-8bea-712b22575993 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:29.028489 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43a404ee-7a70-4354-8bea-712b22575993 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:29.028937 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43a404ee-7a70-4354-8bea-712b22575993 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:29.029717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43a404ee-7a70-4354-8bea-712b22575993 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:29.030170 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43a404ee-7a70-4354-8bea-712b22575993 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:29.277357 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43a404ee-7a70-4354-8bea-712b22575993 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:29.285232 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-43a404ee-7a70-4354-8bea-712b22575993 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1366 microversion: 2.1 time: 0.268548 May 26 13:58:29.285836 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 556/1134] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:29 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:30.302584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-18f229ad-a244-4aac-a018-adc0140e5d01 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:30.303195 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-18f229ad-a244-4aac-a018-adc0140e5d01 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:30.309825 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-18f229ad-a244-4aac-a018-adc0140e5d01 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:30.310276 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-18f229ad-a244-4aac-a018-adc0140e5d01 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:30.311049 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-18f229ad-a244-4aac-a018-adc0140e5d01 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:30.311484 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-18f229ad-a244-4aac-a018-adc0140e5d01 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:30.445456 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-18f229ad-a244-4aac-a018-adc0140e5d01 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:30.453308 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-18f229ad-a244-4aac-a018-adc0140e5d01 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1366 microversion: 2.1 time: 0.154824 May 26 13:58:30.453956 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 579/1135] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:30 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:31.472949 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-eecfcc2c-6127-4963-91ea-bb42e15f673e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:31.473563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-eecfcc2c-6127-4963-91ea-bb42e15f673e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:31.480452 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eecfcc2c-6127-4963-91ea-bb42e15f673e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:31.480895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eecfcc2c-6127-4963-91ea-bb42e15f673e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:31.481661 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eecfcc2c-6127-4963-91ea-bb42e15f673e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:31.482087 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-eecfcc2c-6127-4963-91ea-bb42e15f673e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:31.611164 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-eecfcc2c-6127-4963-91ea-bb42e15f673e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:31.619402 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-eecfcc2c-6127-4963-91ea-bb42e15f673e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1366 microversion: 2.1 time: 0.150329 May 26 13:58:31.619964 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 557/1136] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:31 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:31.859452 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-fea2c771-6f7d-4947-b965-02399f33e849 req-0867b9e2-2d7a-49ef-b2e8-fda08fa6ddf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c048a6df-4889-4011-a072-70b3c965b14e", "name": "network-vif-plugged", "status": "completed", "tag": "8a8f4660-4941-4d34-ba99-bfe395f333c5"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:31.869031 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-fea2c771-6f7d-4947-b965-02399f33e849 req-0867b9e2-2d7a-49ef-b2e8-fda08fa6ddf1 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:31.869370 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-fea2c771-6f7d-4947-b965-02399f33e849 req-0867b9e2-2d7a-49ef-b2e8-fda08fa6ddf1 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:31.880845 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-fea2c771-6f7d-4947-b965-02399f33e849 req-0867b9e2-2d7a-49ef-b2e8-fda08fa6ddf1 service nova] Creating event network-vif-plugged:8a8f4660-4941-4d34-ba99-bfe395f333c5 for instance c048a6df-4889-4011-a072-70b3c965b14e on hv-cinder-81966 May 26 13:58:31.885625 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-fea2c771-6f7d-4947-b965-02399f33e849 req-0867b9e2-2d7a-49ef-b2e8-fda08fa6ddf1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030285 May 26 13:58:31.886231 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 580/1137] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:58:32.636807 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-acc5ee03-dd0c-4022-96b9-f0b620416129 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:32.637426 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-acc5ee03-dd0c-4022-96b9-f0b620416129 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:32.644199 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-acc5ee03-dd0c-4022-96b9-f0b620416129 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:32.644684 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-acc5ee03-dd0c-4022-96b9-f0b620416129 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:32.645586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-acc5ee03-dd0c-4022-96b9-f0b620416129 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:32.646247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-acc5ee03-dd0c-4022-96b9-f0b620416129 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:32.777593 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-acc5ee03-dd0c-4022-96b9-f0b620416129 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:32.785641 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-acc5ee03-dd0c-4022-96b9-f0b620416129 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1366 microversion: 2.1 time: 0.152698 May 26 13:58:32.786212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 558/1138] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:32 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:33.801853 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:33.802855 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=6 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:33.809222 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7900e68c-b676-447a-85c8-c13f94722349 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:33.810287 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7900e68c-b676-447a-85c8-c13f94722349 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:33.821050 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7900e68c-b676-447a-85c8-c13f94722349 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:33.821759 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7900e68c-b676-447a-85c8-c13f94722349 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:33.822931 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7900e68c-b676-447a-85c8-c13f94722349 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:33.823601 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-7900e68c-b676-447a-85c8-c13f94722349 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:33.963962 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7900e68c-b676-447a-85c8-c13f94722349 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:33.972163 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7900e68c-b676-447a-85c8-c13f94722349 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1554 microversion: 2.1 time: 0.171251 May 26 13:58:33.972775 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 581/1139] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:33 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:58:33.989291 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f8f895d9-d893-403e-afb8-9a2837c72a93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:33.989837 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f8f895d9-d893-403e-afb8-9a2837c72a93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:33.996258 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8f895d9-d893-403e-afb8-9a2837c72a93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:33.996815 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8f895d9-d893-403e-afb8-9a2837c72a93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:33.997581 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8f895d9-d893-403e-afb8-9a2837c72a93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:33.998017 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f8f895d9-d893-403e-afb8-9a2837c72a93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:34.077824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f8f895d9-d893-403e-afb8-9a2837c72a93 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092368 May 26 13:58:34.078462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 559/1140] 10.222.0.16 () {58 vars in 1274 bytes} [Thu May 26 13:58:33 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:58:35.407401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-c31a4922-4d5e-4431-9a12-e34e7a28ab2a req-177e78fe-eecf-4407-bd55-8b85fa0abebd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c048a6df-4889-4011-a072-70b3c965b14e", "tag": "8a8f4660-4941-4d34-ba99-bfe395f333c5"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:35.417579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-c31a4922-4d5e-4431-9a12-e34e7a28ab2a req-177e78fe-eecf-4407-bd55-8b85fa0abebd service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:35.418015 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-c31a4922-4d5e-4431-9a12-e34e7a28ab2a req-177e78fe-eecf-4407-bd55-8b85fa0abebd service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:35.430087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-c31a4922-4d5e-4431-9a12-e34e7a28ab2a req-177e78fe-eecf-4407-bd55-8b85fa0abebd service nova] Creating event network-changed:8a8f4660-4941-4d34-ba99-bfe395f333c5 for instance c048a6df-4889-4011-a072-70b3c965b14e on hv-cinder-81966 May 26 13:58:35.435579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-c31a4922-4d5e-4431-9a12-e34e7a28ab2a req-177e78fe-eecf-4407-bd55-8b85fa0abebd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031823 May 26 13:58:35.436424 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 582/1141] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:58:58.087207 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:58.088730 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:58.089386 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:58.093524 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-85379300", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-18808065", "security_groups": [{"name": "tempest-secgroup-smoke-1175980800"}], "block_device_mapping_v2": [{"uuid": "efbfbdcf-5501-4feb-b838-76279275a34a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f13feac7-9894-4fb0-8d65-5458a77bde4c"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:58:58.208027 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] validate_networks() for [('f13feac7-9894-4fb0-8d65-5458a77bde4c', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 13:58:58.584089 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 13:58:58.584539 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 13:58:58.585012 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 13:58:58.585417 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 13:58:58.585825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 13:58:58.594775 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:58.595220 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:58.596006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:58:58.596586 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:58:58.612730 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Getting quotas for project 189885bf9a5944bf8eaedd89bb5bec9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 13:58:58.616693 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Getting quotas for user f98684788906448bb3b35af5a2fc017f and project 189885bf9a5944bf8eaedd89bb5bec9f. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 13:58:58.674462 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 13:58:58.676844 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='efbfbdcf-5501-4feb-b838-76279275a34a',volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 13:58:58.804893 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [2e9a3fdd-889d-4a79-93cc-84778b49a8cf] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 13:58:59.812568 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [2e9a3fdd-889d-4a79-93cc-84778b49a8cf] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 57090. May 26 13:58:59.816486 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0bbd48c5-6039-4725-88b2-ca8a0f963d35 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.729987 May 26 13:58:59.817128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 560/1142] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 13:58:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 13:58:59.825099 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:59.825927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:58:59.830363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-44348812-a848-4cf5-9484-730f3adf24bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:58:59.831964 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-44348812-a848-4cf5-9484-730f3adf24bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:58:59.890076 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-44348812-a848-4cf5-9484-730f3adf24bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:58:59.897503 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-44348812-a848-4cf5-9484-730f3adf24bb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1091 microversion: 2.1 time: 0.074046 May 26 13:58:59.898066 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 583/1143] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:58:59 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1091 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:00.919899 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-bd322b9b-3b14-4e07-89de-0e5ff911a23d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:00.920542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-bd322b9b-3b14-4e07-89de-0e5ff911a23d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:00.977982 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-bd322b9b-3b14-4e07-89de-0e5ff911a23d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:00.984870 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-bd322b9b-3b14-4e07-89de-0e5ff911a23d tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1091 microversion: 2.1 time: 0.069233 May 26 13:59:00.985341 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 561/1144] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:00 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1091 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:02.002262 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fcdca3df-1e77-439f-a311-c2d0298e3cf0 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:02.003663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fcdca3df-1e77-439f-a311-c2d0298e3cf0 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:02.060966 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fcdca3df-1e77-439f-a311-c2d0298e3cf0 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:02.068383 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fcdca3df-1e77-439f-a311-c2d0298e3cf0 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1091 microversion: 2.1 time: 0.070038 May 26 13:59:02.068955 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 584/1145] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:01 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1091 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:03.084659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-14848e7f-dcbe-44f7-b6fa-cbf53f2ab5d4 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:03.085352 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-14848e7f-dcbe-44f7-b6fa-cbf53f2ab5d4 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:03.141193 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-14848e7f-dcbe-44f7-b6fa-cbf53f2ab5d4 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:03.148652 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-14848e7f-dcbe-44f7-b6fa-cbf53f2ab5d4 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1091 microversion: 2.1 time: 0.068095 May 26 13:59:03.149252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 562/1146] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:03 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1091 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:04.168689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c8e3bb18-0b7e-4c63-95fa-c942fbaa6baf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:04.169335 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c8e3bb18-0b7e-4c63-95fa-c942fbaa6baf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:04.176527 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c8e3bb18-0b7e-4c63-95fa-c942fbaa6baf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:04.176973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c8e3bb18-0b7e-4c63-95fa-c942fbaa6baf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:04.177731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c8e3bb18-0b7e-4c63-95fa-c942fbaa6baf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:04.178163 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c8e3bb18-0b7e-4c63-95fa-c942fbaa6baf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:04.240836 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c8e3bb18-0b7e-4c63-95fa-c942fbaa6baf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:04.248395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c8e3bb18-0b7e-4c63-95fa-c942fbaa6baf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1141 microversion: 2.1 time: 0.083546 May 26 13:59:04.248965 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 585/1147] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:04 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1141 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:05.266315 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-53034b4c-9c55-45a0-8b56-af5190172344 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:05.267274 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-53034b4c-9c55-45a0-8b56-af5190172344 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:05.276214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53034b4c-9c55-45a0-8b56-af5190172344 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:05.276723 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53034b4c-9c55-45a0-8b56-af5190172344 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:05.277692 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53034b4c-9c55-45a0-8b56-af5190172344 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:05.278134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53034b4c-9c55-45a0-8b56-af5190172344 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:05.366920 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53034b4c-9c55-45a0-8b56-af5190172344 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:05.374635 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-53034b4c-9c55-45a0-8b56-af5190172344 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1207 microversion: 2.1 time: 0.113367 May 26 13:59:05.375283 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 563/1148] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:05 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1207 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:06.200563 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-ee8b3f5e-feec-4fb4-81e7-8082a3273bbc req-30249b6b-c2df-4fa1-b413-0adb6329946f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a211c6e1-d293-4f55-b321-4d4a4b1f0459", "tag": "e58634cf-9a7b-4f26-bfa5-33d613e98bab"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:06.211426 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-ee8b3f5e-feec-4fb4-81e7-8082a3273bbc req-30249b6b-c2df-4fa1-b413-0adb6329946f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:06.212120 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-ee8b3f5e-feec-4fb4-81e7-8082a3273bbc req-30249b6b-c2df-4fa1-b413-0adb6329946f service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:06.226616 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-ee8b3f5e-feec-4fb4-81e7-8082a3273bbc req-30249b6b-c2df-4fa1-b413-0adb6329946f service nova] Creating event network-changed:e58634cf-9a7b-4f26-bfa5-33d613e98bab for instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 on hv-cinder-81966 May 26 13:59:06.231812 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-ee8b3f5e-feec-4fb4-81e7-8082a3273bbc req-30249b6b-c2df-4fa1-b413-0adb6329946f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036262 May 26 13:59:06.232753 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 586/1149] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:06.391643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b278107e-2d20-48a1-80b5-7f3e9d1bcdaf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:06.392259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b278107e-2d20-48a1-80b5-7f3e9d1bcdaf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:06.399732 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b278107e-2d20-48a1-80b5-7f3e9d1bcdaf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:06.400190 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b278107e-2d20-48a1-80b5-7f3e9d1bcdaf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:06.400995 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b278107e-2d20-48a1-80b5-7f3e9d1bcdaf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:06.401433 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b278107e-2d20-48a1-80b5-7f3e9d1bcdaf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:06.642225 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b278107e-2d20-48a1-80b5-7f3e9d1bcdaf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:06.650470 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b278107e-2d20-48a1-80b5-7f3e9d1bcdaf tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.262256 May 26 13:59:06.651500 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 564/1150] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:06 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:07.671209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a6001105-bdd2-4794-abf0-43e6538fccfe tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:07.672012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a6001105-bdd2-4794-abf0-43e6538fccfe tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:07.678518 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a6001105-bdd2-4794-abf0-43e6538fccfe tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:07.679044 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a6001105-bdd2-4794-abf0-43e6538fccfe tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:07.679743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a6001105-bdd2-4794-abf0-43e6538fccfe tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:07.680186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a6001105-bdd2-4794-abf0-43e6538fccfe tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:07.823544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a6001105-bdd2-4794-abf0-43e6538fccfe tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:07.831678 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a6001105-bdd2-4794-abf0-43e6538fccfe tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.165121 May 26 13:59:07.832255 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 587/1151] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:07 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:08.849405 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-39748570-f71d-412a-8720-1cf64ef37144 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:08.850018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-39748570-f71d-412a-8720-1cf64ef37144 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:08.852414 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:08.858363 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39748570-f71d-412a-8720-1cf64ef37144 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:08.858816 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39748570-f71d-412a-8720-1cf64ef37144 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:08.859609 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39748570-f71d-412a-8720-1cf64ef37144 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:08.860049 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-39748570-f71d-412a-8720-1cf64ef37144 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:08.995803 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-39748570-f71d-412a-8720-1cf64ef37144 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:09.003975 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-39748570-f71d-412a-8720-1cf64ef37144 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.158912 May 26 13:59:09.004708 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 565/1152] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:08 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:10.021546 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-68907112-c3b1-419c-905a-2181c5ed720a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:10.022155 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-68907112-c3b1-419c-905a-2181c5ed720a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:10.028726 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-68907112-c3b1-419c-905a-2181c5ed720a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:10.029179 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-68907112-c3b1-419c-905a-2181c5ed720a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:10.029945 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-68907112-c3b1-419c-905a-2181c5ed720a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:10.030384 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-68907112-c3b1-419c-905a-2181c5ed720a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:10.163481 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-68907112-c3b1-419c-905a-2181c5ed720a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:10.170977 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-68907112-c3b1-419c-905a-2181c5ed720a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.154019 May 26 13:59:10.171480 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 588/1153] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:10 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:11.191802 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-84f6b7f1-af4b-4c6b-a8d6-22c06682f797 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:11.192776 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-84f6b7f1-af4b-4c6b-a8d6-22c06682f797 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:11.201031 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84f6b7f1-af4b-4c6b-a8d6-22c06682f797 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:11.201477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84f6b7f1-af4b-4c6b-a8d6-22c06682f797 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:11.202238 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84f6b7f1-af4b-4c6b-a8d6-22c06682f797 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:11.202667 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-84f6b7f1-af4b-4c6b-a8d6-22c06682f797 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:11.333602 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-84f6b7f1-af4b-4c6b-a8d6-22c06682f797 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:11.341112 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-84f6b7f1-af4b-4c6b-a8d6-22c06682f797 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.153451 May 26 13:59:11.341689 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 566/1154] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:11 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:12.358448 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-83cd24cb-7385-4e4b-90f1-1df1f751d31a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:12.359071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-83cd24cb-7385-4e4b-90f1-1df1f751d31a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:12.361554 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=4 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:12.367674 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-83cd24cb-7385-4e4b-90f1-1df1f751d31a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:12.368118 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-83cd24cb-7385-4e4b-90f1-1df1f751d31a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:12.368914 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-83cd24cb-7385-4e4b-90f1-1df1f751d31a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:12.369344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-83cd24cb-7385-4e4b-90f1-1df1f751d31a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:12.507775 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-83cd24cb-7385-4e4b-90f1-1df1f751d31a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:12.515234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-83cd24cb-7385-4e4b-90f1-1df1f751d31a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.161008 May 26 13:59:12.515798 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 589/1155] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:12 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:13.532697 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-136da6f6-af92-47bc-a99b-5613e5f63fb5 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:13.533307 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-136da6f6-af92-47bc-a99b-5613e5f63fb5 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:13.536324 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=10 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:13.541983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-136da6f6-af92-47bc-a99b-5613e5f63fb5 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:13.542434 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-136da6f6-af92-47bc-a99b-5613e5f63fb5 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:13.543215 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-136da6f6-af92-47bc-a99b-5613e5f63fb5 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:13.543654 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-136da6f6-af92-47bc-a99b-5613e5f63fb5 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:13.676951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-136da6f6-af92-47bc-a99b-5613e5f63fb5 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:13.684689 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-136da6f6-af92-47bc-a99b-5613e5f63fb5 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.155808 May 26 13:59:13.685258 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 567/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:13 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:14.702953 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8dae84fb-fe97-4e92-acf8-2c1c30df956e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:14.703561 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8dae84fb-fe97-4e92-acf8-2c1c30df956e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:14.710489 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8dae84fb-fe97-4e92-acf8-2c1c30df956e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:14.710950 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8dae84fb-fe97-4e92-acf8-2c1c30df956e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:14.711691 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8dae84fb-fe97-4e92-acf8-2c1c30df956e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:14.712116 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8dae84fb-fe97-4e92-acf8-2c1c30df956e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:14.846575 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-8dae84fb-fe97-4e92-acf8-2c1c30df956e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:14.854089 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8dae84fb-fe97-4e92-acf8-2c1c30df956e tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.155256 May 26 13:59:14.854664 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 590/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:14 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:15.871426 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d897679-2ef3-4d8e-9081-c0e7f245c41f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:15.872041 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d897679-2ef3-4d8e-9081-c0e7f245c41f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:15.879709 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d897679-2ef3-4d8e-9081-c0e7f245c41f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:15.880151 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d897679-2ef3-4d8e-9081-c0e7f245c41f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:15.880943 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d897679-2ef3-4d8e-9081-c0e7f245c41f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:15.881372 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d897679-2ef3-4d8e-9081-c0e7f245c41f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:16.016000 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-9d897679-2ef3-4d8e-9081-c0e7f245c41f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:16.024364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d897679-2ef3-4d8e-9081-c0e7f245c41f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.156897 May 26 13:59:16.024941 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 568/1158] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:15 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:17.041920 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-70998da8-62ad-4a98-9431-6c9e2f0334f8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:17.042530 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-70998da8-62ad-4a98-9431-6c9e2f0334f8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:17.049085 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-70998da8-62ad-4a98-9431-6c9e2f0334f8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:17.049632 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-70998da8-62ad-4a98-9431-6c9e2f0334f8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:17.050463 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-70998da8-62ad-4a98-9431-6c9e2f0334f8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:17.050899 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-70998da8-62ad-4a98-9431-6c9e2f0334f8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:17.182743 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-70998da8-62ad-4a98-9431-6c9e2f0334f8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:17.190395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-70998da8-62ad-4a98-9431-6c9e2f0334f8 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.152220 May 26 13:59:17.190915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 591/1159] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:17 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 13:59:18.071515 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-2de9fc0f-3670-4413-b64e-f0bc59c64797 req-8d58b488-073e-4c70-9924-dc87e4fcb019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a211c6e1-d293-4f55-b321-4d4a4b1f0459", "name": "network-vif-plugged", "status": "completed", "tag": "e58634cf-9a7b-4f26-bfa5-33d613e98bab"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:18.082041 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-2de9fc0f-3670-4413-b64e-f0bc59c64797 req-8d58b488-073e-4c70-9924-dc87e4fcb019 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:18.082707 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-2de9fc0f-3670-4413-b64e-f0bc59c64797 req-8d58b488-073e-4c70-9924-dc87e4fcb019 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:18.094194 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-2de9fc0f-3670-4413-b64e-f0bc59c64797 req-8d58b488-073e-4c70-9924-dc87e4fcb019 service nova] Creating event network-vif-plugged:e58634cf-9a7b-4f26-bfa5-33d613e98bab for instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 on hv-cinder-81966 May 26 13:59:18.100019 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-2de9fc0f-3670-4413-b64e-f0bc59c64797 req-8d58b488-073e-4c70-9924-dc87e4fcb019 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032629 May 26 13:59:18.100830 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 569/1160] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:18.206938 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b3a781f9-e28f-4c33-98c5-1c628fdfe981 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:18.207544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b3a781f9-e28f-4c33-98c5-1c628fdfe981 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:18.215554 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b3a781f9-e28f-4c33-98c5-1c628fdfe981 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:18.216018 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b3a781f9-e28f-4c33-98c5-1c628fdfe981 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:18.216810 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b3a781f9-e28f-4c33-98c5-1c628fdfe981 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:18.217243 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b3a781f9-e28f-4c33-98c5-1c628fdfe981 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:18.354007 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-b3a781f9-e28f-4c33-98c5-1c628fdfe981 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:18.362543 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b3a781f9-e28f-4c33-98c5-1c628fdfe981 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.158772 May 26 13:59:18.363139 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 592/1161] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:18 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:19.380597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3ea85866-2684-4c64-b99c-1ae5ff522fbb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:19.381282 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3ea85866-2684-4c64-b99c-1ae5ff522fbb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:19.388110 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ea85866-2684-4c64-b99c-1ae5ff522fbb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:19.388591 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ea85866-2684-4c64-b99c-1ae5ff522fbb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:19.389356 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ea85866-2684-4c64-b99c-1ae5ff522fbb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:19.389792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3ea85866-2684-4c64-b99c-1ae5ff522fbb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:19.547619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-3ea85866-2684-4c64-b99c-1ae5ff522fbb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:19.556626 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3ea85866-2684-4c64-b99c-1ae5ff522fbb tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1263 microversion: 2.1 time: 0.180924 May 26 13:59:19.557266 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 570/1162] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:19 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:20.573555 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3440a329-9730-480e-a2a3-0a737ef390e1 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:20.574170 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3440a329-9730-480e-a2a3-0a737ef390e1 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:20.581983 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3440a329-9730-480e-a2a3-0a737ef390e1 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:20.582487 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3440a329-9730-480e-a2a3-0a737ef390e1 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:20.583549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3440a329-9730-480e-a2a3-0a737ef390e1 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:20.583992 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3440a329-9730-480e-a2a3-0a737ef390e1 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:20.728099 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3440a329-9730-480e-a2a3-0a737ef390e1 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:20.736450 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3440a329-9730-480e-a2a3-0a737ef390e1 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1450 microversion: 2.1 time: 0.166572 May 26 13:59:20.737489 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 593/1163] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:20 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:20.755201 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-1b438529-94b6-4ff1-abcd-995089df3b5a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:20.755899 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-1b438529-94b6-4ff1-abcd-995089df3b5a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:20.762477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b438529-94b6-4ff1-abcd-995089df3b5a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:20.762953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b438529-94b6-4ff1-abcd-995089df3b5a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:20.763813 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b438529-94b6-4ff1-abcd-995089df3b5a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:20.764279 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-1b438529-94b6-4ff1-abcd-995089df3b5a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:20.915741 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-1b438529-94b6-4ff1-abcd-995089df3b5a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 13:59:20.923363 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-1b438529-94b6-4ff1-abcd-995089df3b5a tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1450 microversion: 2.1 time: 0.173244 May 26 13:59:20.923951 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 571/1164] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 13:59:20 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 13:59:22.760660 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-e9cef626-e120-437a-9385-818a2a5bf460 req-a0a4aaf5-4a75-4624-b617-d1c4cc2c1284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a211c6e1-d293-4f55-b321-4d4a4b1f0459", "tag": "e58634cf-9a7b-4f26-bfa5-33d613e98bab"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:22.770002 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e9cef626-e120-437a-9385-818a2a5bf460 req-a0a4aaf5-4a75-4624-b617-d1c4cc2c1284 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:22.770438 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e9cef626-e120-437a-9385-818a2a5bf460 req-a0a4aaf5-4a75-4624-b617-d1c4cc2c1284 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:22.781470 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-e9cef626-e120-437a-9385-818a2a5bf460 req-a0a4aaf5-4a75-4624-b617-d1c4cc2c1284 service nova] Creating event network-changed:e58634cf-9a7b-4f26-bfa5-33d613e98bab for instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 on hv-cinder-81966 May 26 13:59:22.786423 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-e9cef626-e120-437a-9385-818a2a5bf460 req-a0a4aaf5-4a75-4624-b617-d1c4cc2c1284 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029400 May 26 13:59:22.787236 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 594/1165] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 13:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:50.495877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-32c0c53c-7ec3-4923-a2c4-b7fad3d1e6d6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 13:59:50.496639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-32c0c53c-7ec3-4923-a2c4-b7fad3d1e6d6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:50.499990 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:50.500643 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=52 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:50.505641 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32c0c53c-7ec3-4923-a2c4-b7fad3d1e6d6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:50.506081 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32c0c53c-7ec3-4923-a2c4-b7fad3d1e6d6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:50.506932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32c0c53c-7ec3-4923-a2c4-b7fad3d1e6d6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:50.507441 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-32c0c53c-7ec3-4923-a2c4-b7fad3d1e6d6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:50.536617 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-32c0c53c-7ec3-4923-a2c4-b7fad3d1e6d6 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/ips" status: 200 len: 148 microversion: 2.1 time: 0.045485 May 26 13:59:50.537204 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 572/1166] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 13:59:50 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/ips => generated 148 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:51.889944 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=28 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:51.891763 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=52 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:59:51.897544 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-8cf76078-725f-4a7d-821b-a1b3fa1603de tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebabc5e5-7849-47ee-9549-b29c249b63b9"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:51.899188 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-8cf76078-725f-4a7d-821b-a1b3fa1603de tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:51.906767 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8cf76078-725f-4a7d-821b-a1b3fa1603de tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:51.907234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8cf76078-725f-4a7d-821b-a1b3fa1603de tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:51.909395 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8cf76078-725f-4a7d-821b-a1b3fa1603de tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:51.910071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-8cf76078-725f-4a7d-821b-a1b3fa1603de tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:52.225226 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-8cf76078-725f-4a7d-821b-a1b3fa1603de tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337251 May 26 13:59:52.226174 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 595/1167] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:59:51 2022] POST /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 13:59:59.767222 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebabc5e5-7849-47ee-9549-b29c249b63b9"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 13:59:59.767222 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 13:59:59.770764 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:59.771213 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:59.772006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 13:59:59.772482 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 13:59:59.960761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Invalid volume: volume ebabc5e5-7849-47ee-9549-b29c249b63b9 is already attached to instances: c048a6df-4889-4011-a072-70b3c965b14e May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: POST /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments HTTP/1.1 May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 74 May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 13:59:59.962477 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {"volumeAttachment": {"volumeId": "ebabc5e5-7849-47ee-9549-b29c249b63b9"}} May 26 13:59:59.964175 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Invalid volume: volume ebabc5e5-7849-47ee-9549-b29c249b63b9 is already attached to instances: c048a6df-4889-4011-a072-70b3c965b14e May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'server_id': 'c048a6df-4889-4011-a072-70b3c965b14e', 'body': {'volumeAttachment': {'volumeId': 'ebabc5e5-7849-47ee-9549-b29c249b63b9'}}} May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ebabc5e5-7849-47ee-9549-b29c249b63b9 is already attached to instances: c048a6df-4889-4011-a072-70b3c965b14e May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:59:59.965227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ebabc5e5-7849-47ee-9549-b29c249b63b9 is already attached to instances: c048a6df-4889-4011-a072-70b3c965b14e May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 13:59:59.966907 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 13:59:59.968726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 13:59:59.968726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 13:59:59.968726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 13:59:59.968726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ebabc5e5-7849-47ee-9549-b29c249b63b9 is already attached to instances: c048a6df-4889-4011-a072-70b3c965b14e May 26 13:59:59.968726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 13:59:59.968726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 400 to user: Invalid volume: volume ebabc5e5-7849-47ee-9549-b29c249b63b9 is already attached to instances: c048a6df-4889-4011-a072-70b3c965b14e {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 13:59:59.968726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5d867caa-7519-4bcb-ba91-a80ef4b632a5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.205879 May 26 13:59:59.968726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 573/1168] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 13:59:59 2022] POST /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments => generated 174 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 14:00:00.030940 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-76ced0a2-8406-4739-aec4-b83e1df9cec0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:00.031598 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-76ced0a2-8406-4739-aec4-b83e1df9cec0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:00.039178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-76ced0a2-8406-4739-aec4-b83e1df9cec0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:00.039626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-76ced0a2-8406-4739-aec4-b83e1df9cec0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:00.040429 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-76ced0a2-8406-4739-aec4-b83e1df9cec0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:00.040867 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-76ced0a2-8406-4739-aec4-b83e1df9cec0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:00.186214 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-76ced0a2-8406-4739-aec4-b83e1df9cec0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lazy-loading 'services' on Instance uuid c048a6df-4889-4011-a072-70b3c965b14e {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:00:00.260218 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-76ced0a2-8406-4739-aec4-b83e1df9cec0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments/ebabc5e5-7849-47ee-9549-b29c249b63b9" status: 202 len: 0 microversion: 2.1 time: 0.233031 May 26 14:00:00.261411 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 596/1169] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 14:00:00 2022] DELETE /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments/ebabc5e5-7849-47ee-9549-b29c249b63b9 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:00:00.278192 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7058578a-eeb1-4af9-9688-685ca5295315 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:00.279223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7058578a-eeb1-4af9-9688-685ca5295315 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:00.286361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7058578a-eeb1-4af9-9688-685ca5295315 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:00.286976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7058578a-eeb1-4af9-9688-685ca5295315 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:00.288337 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7058578a-eeb1-4af9-9688-685ca5295315 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:00.289030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7058578a-eeb1-4af9-9688-685ca5295315 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:00.323504 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7058578a-eeb1-4af9-9688-685ca5295315 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053850 May 26 14:00:00.324015 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 574/1170] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 14:00:00 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:01.337038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-5f32dbd2-23cf-4b82-86f5-1bf3adc4b2d3 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:01.338196 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-5f32dbd2-23cf-4b82-86f5-1bf3adc4b2d3 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:01.344765 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f32dbd2-23cf-4b82-86f5-1bf3adc4b2d3 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:01.345216 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f32dbd2-23cf-4b82-86f5-1bf3adc4b2d3 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:01.346755 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f32dbd2-23cf-4b82-86f5-1bf3adc4b2d3 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:01.347192 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-5f32dbd2-23cf-4b82-86f5-1bf3adc4b2d3 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:01.377696 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-5f32dbd2-23cf-4b82-86f5-1bf3adc4b2d3 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045737 May 26 14:00:01.378266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 597/1171] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 14:00:01 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:00:01.443172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-004bfdc4-509d-4476-b875-fc2e79b1e38c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:01.443729 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-004bfdc4-509d-4476-b875-fc2e79b1e38c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:01.450359 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004bfdc4-509d-4476-b875-fc2e79b1e38c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:01.450809 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004bfdc4-509d-4476-b875-fc2e79b1e38c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:01.451576 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004bfdc4-509d-4476-b875-fc2e79b1e38c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:01.452010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-004bfdc4-509d-4476-b875-fc2e79b1e38c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:01.477546 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-004bfdc4-509d-4476-b875-fc2e79b1e38c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:00:01.554160 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-004bfdc4-509d-4476-b875-fc2e79b1e38c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 204 len: 0 microversion: 2.1 time: 0.114693 May 26 14:00:01.554834 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 575/1172] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:00:01 2022] DELETE /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:00:01.563858 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-86d5d031-3a5f-495d-adca-39ad6daf518b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:01.564636 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-86d5d031-3a5f-495d-adca-39ad6daf518b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:01.570901 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86d5d031-3a5f-495d-adca-39ad6daf518b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:01.571349 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86d5d031-3a5f-495d-adca-39ad6daf518b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:01.572664 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86d5d031-3a5f-495d-adca-39ad6daf518b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:01.572664 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-86d5d031-3a5f-495d-adca-39ad6daf518b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:01.718296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-86d5d031-3a5f-495d-adca-39ad6daf518b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:01.726846 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-86d5d031-3a5f-495d-adca-39ad6daf518b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1679 microversion: 2.1 time: 0.167522 May 26 14:00:01.727448 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 598/1173] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:01 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:02.745374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-d3fce6b4-0ec7-457b-8b60-9a42884c66b4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:02.746074 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-d3fce6b4-0ec7-457b-8b60-9a42884c66b4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:02.753312 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3fce6b4-0ec7-457b-8b60-9a42884c66b4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:02.753767 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3fce6b4-0ec7-457b-8b60-9a42884c66b4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:02.754538 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3fce6b4-0ec7-457b-8b60-9a42884c66b4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:02.754976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-d3fce6b4-0ec7-457b-8b60-9a42884c66b4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:02.893217 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-d3fce6b4-0ec7-457b-8b60-9a42884c66b4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:02.900899 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-d3fce6b4-0ec7-457b-8b60-9a42884c66b4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1679 microversion: 2.1 time: 0.159809 May 26 14:00:02.901480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 576/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:02 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:03.922180 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-162fee56-87c4-4056-bcd6-319e1f5bdaf5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:03.922726 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-162fee56-87c4-4056-bcd6-319e1f5bdaf5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:03.930730 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-162fee56-87c4-4056-bcd6-319e1f5bdaf5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:03.930877 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-162fee56-87c4-4056-bcd6-319e1f5bdaf5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:03.931584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-162fee56-87c4-4056-bcd6-319e1f5bdaf5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:03.932025 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-162fee56-87c4-4056-bcd6-319e1f5bdaf5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:04.066908 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-162fee56-87c4-4056-bcd6-319e1f5bdaf5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:04.074973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-162fee56-87c4-4056-bcd6-319e1f5bdaf5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 200 len: 1679 microversion: 2.1 time: 0.156601 May 26 14:00:04.075646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 599/1175] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:03 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:04.370935 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-b8141b60-adc9-41cd-a1c6-41427fe850c2 req-8ab42faf-9c49-4c1b-9b68-4ada25bb9fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c048a6df-4889-4011-a072-70b3c965b14e", "name": "network-vif-deleted", "tag": "8a8f4660-4941-4d34-ba99-bfe395f333c5"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:04.380672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-b8141b60-adc9-41cd-a1c6-41427fe850c2 req-8ab42faf-9c49-4c1b-9b68-4ada25bb9fef service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:04.381467 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-b8141b60-adc9-41cd-a1c6-41427fe850c2 req-8ab42faf-9c49-4c1b-9b68-4ada25bb9fef service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:04.394364 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-b8141b60-adc9-41cd-a1c6-41427fe850c2 req-8ab42faf-9c49-4c1b-9b68-4ada25bb9fef service nova] Creating event network-vif-deleted:8a8f4660-4941-4d34-ba99-bfe395f333c5 for instance c048a6df-4889-4011-a072-70b3c965b14e on hv-cinder-81966 May 26 14:00:04.400178 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-b8141b60-adc9-41cd-a1c6-41427fe850c2 req-8ab42faf-9c49-4c1b-9b68-4ada25bb9fef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032812 May 26 14:00:04.401028 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 577/1176] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:05.094316 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:05.094934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:05.102280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:05.102671 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:05.103441 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:05.103883 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:05.118868 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e HTTP/1.1 May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 14:00:05.120547 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:00:05.121968 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'c048a6df-4889-4011-a072-70b3c965b14e'} May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:00:05.122788 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:00:05.124110 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:00:05.125304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:00:05.125304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-32cc7994-540c-46f7-8520-52a33fa7b8a7 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 404 len: 111 microversion: 2.1 time: 0.032571 May 26 14:00:05.125304 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 600/1177] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:05 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:00:05.132638 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7cb84cb4-8fb2-4ad0-b8ea-7fea7f371df0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '.version_select at 0x7f07e0422820>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:05.152096 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7cb84cb4-8fb2-4ad0-b8ea-7fea7f371df0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-892430461" status: 202 len: 0 microversion: 2.1 time: 0.023976 May 26 14:00:05.152739 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 578/1178] 10.222.0.16 () {58 vars in 1217 bytes} [Thu May 26 14:00:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-892430461 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:00:05.839296 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c4c7daed-ea33-4532-b88d-a4c788e0925e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: .version_select at 0x7f07e03303a0>, body: {"keypair": {"name": "tempest-keypair-717716847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2eA3LSi67A+uNl8nQ6ic/gF4Npq1OOCgrREoVEa9kOm8SpEFFa3m+v3rwFdONYBfW3H3c3GMhodGxzLb8j88jny9tdBGgYMwfDAaGbuPI466+JqTSEao8mdnNeL78Xmw=="}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:05.854133 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-c4c7daed-ea33-4532-b88d-a4c788e0925e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for project b596535d63d6490eb939c300bfe565cf. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:00:05.858364 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.quota [None req-c4c7daed-ea33-4532-b88d-a4c788e0925e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for user ae843854dccd4c28a260d040be460db0 and project b596535d63d6490eb939c300bfe565cf. Resources: {'key_pairs'} {{(pid=124240) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:00:05.885077 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c4c7daed-ea33-4532-b88d-a4c788e0925e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049540 May 26 14:00:05.885733 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 601/1179] 10.222.0.16 () {60 vars in 1158 bytes} [Thu May 26 14:00:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:07.230542 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-129858575", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9be8c897-5f1a-4707-b0ba-c3382fad4d2e"}], "security_groups": [{"name": "tempest-securitygroup--1594899044"}], "key_name": "tempest-keypair-717716847", "user_data": "}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:07.341497 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] validate_networks() for [('9be8c897-5f1a-4707-b0ba-c3382fad4d2e', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:00:07.976919 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:00:07.977341 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:00:07.977808 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:00:07.978211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:00:07.978616 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:00:07.987521 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:07.987962 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:07.988796 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:07.989231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:08.006136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for project b596535d63d6490eb939c300bfe565cf. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:00:08.010327 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Getting quotas for user ae843854dccd4c28a260d040be460db0 and project b596535d63d6490eb939c300bfe565cf. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:00:08.021861 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:00:08.024254 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:00:08.071869 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6a197763-1f31-4bf1-9b11-3b29d5744120 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.846366 May 26 14:00:08.072548 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 579/1180] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 14:00:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:00:08.083086 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fa6c368b-453e-43f2-8bad-ced669769c60 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:08.083734 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fa6c368b-453e-43f2-8bad-ced669769c60 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:08.145142 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-fa6c368b-453e-43f2-8bad-ced669769c60 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:08.153173 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fa6c368b-453e-43f2-8bad-ced669769c60 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1240 microversion: 2.1 time: 0.074487 May 26 14:00:08.153689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 602/1181] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:08 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:09.170159 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-732d6920-f252-434e-aec9-b62729f8049b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:09.170683 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-732d6920-f252-434e-aec9-b62729f8049b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:09.178384 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-732d6920-f252-434e-aec9-b62729f8049b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:09.178822 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-732d6920-f252-434e-aec9-b62729f8049b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:09.179672 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-732d6920-f252-434e-aec9-b62729f8049b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:09.180007 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-732d6920-f252-434e-aec9-b62729f8049b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:09.259808 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-732d6920-f252-434e-aec9-b62729f8049b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:09.268770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-732d6920-f252-434e-aec9-b62729f8049b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1298 microversion: 2.1 time: 0.102412 May 26 14:00:09.269446 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 580/1182] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:09 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:10.287636 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-bf71ded8-cef4-449c-bd2e-2af481788fe4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:10.288973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-bf71ded8-cef4-449c-bd2e-2af481788fe4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:10.297574 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bf71ded8-cef4-449c-bd2e-2af481788fe4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.298064 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bf71ded8-cef4-449c-bd2e-2af481788fe4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.299428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bf71ded8-cef4-449c-bd2e-2af481788fe4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.299870 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-bf71ded8-cef4-449c-bd2e-2af481788fe4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.489782 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-bf71ded8-cef4-449c-bd2e-2af481788fe4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:10.498663 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-bf71ded8-cef4-449c-bd2e-2af481788fe4 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1366 microversion: 2.1 time: 0.215501 May 26 14:00:10.499669 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 603/1183] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:10 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:10.581495 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-335ae1ea-4d4b-45fd-a662-52e3f76545aa req-c832332c-cf0d-4eef-bb9c-153fffa34b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535acfc4-e895-4532-a6b4-5155bf29ee93", "tag": "d5b45128-eac9-4421-bc8a-3d7ad0b10646"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:10.608901 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-335ae1ea-4d4b-45fd-a662-52e3f76545aa req-c832332c-cf0d-4eef-bb9c-153fffa34b58 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:10.609600 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-335ae1ea-4d4b-45fd-a662-52e3f76545aa req-c832332c-cf0d-4eef-bb9c-153fffa34b58 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:10.628844 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-335ae1ea-4d4b-45fd-a662-52e3f76545aa req-c832332c-cf0d-4eef-bb9c-153fffa34b58 service nova] Creating event network-changed:d5b45128-eac9-4421-bc8a-3d7ad0b10646 for instance 535acfc4-e895-4532-a6b4-5155bf29ee93 on hv-cinder-81966 May 26 14:00:10.634076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-335ae1ea-4d4b-45fd-a662-52e3f76545aa req-c832332c-cf0d-4eef-bb9c-153fffa34b58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058455 May 26 14:00:10.635077 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 581/1184] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:11.518852 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-14fb08d8-84ba-4cca-84de-5688b5f58f8e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:11.519462 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-14fb08d8-84ba-4cca-84de-5688b5f58f8e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:11.525961 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14fb08d8-84ba-4cca-84de-5688b5f58f8e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:11.526419 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14fb08d8-84ba-4cca-84de-5688b5f58f8e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:11.527184 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14fb08d8-84ba-4cca-84de-5688b5f58f8e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:11.527622 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-14fb08d8-84ba-4cca-84de-5688b5f58f8e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:11.660224 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-14fb08d8-84ba-4cca-84de-5688b5f58f8e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:11.667560 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-14fb08d8-84ba-4cca-84de-5688b5f58f8e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1366 microversion: 2.1 time: 0.152682 May 26 14:00:11.668116 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 604/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:11 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:12.731043 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-13a0af15-72b6-4beb-85ec-3aec70685fac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:12.731743 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-13a0af15-72b6-4beb-85ec-3aec70685fac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:12.740383 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13a0af15-72b6-4beb-85ec-3aec70685fac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:12.741202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13a0af15-72b6-4beb-85ec-3aec70685fac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:12.742141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13a0af15-72b6-4beb-85ec-3aec70685fac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:12.742590 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-13a0af15-72b6-4beb-85ec-3aec70685fac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:12.878042 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-13a0af15-72b6-4beb-85ec-3aec70685fac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:12.885406 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-13a0af15-72b6-4beb-85ec-3aec70685fac tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1366 microversion: 2.1 time: 0.203890 May 26 14:00:12.885972 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 582/1186] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:12 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:13.903188 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-57e598e7-ab30-4389-9a38-dabc6b10e352 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:13.903813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-57e598e7-ab30-4389-9a38-dabc6b10e352 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:13.911051 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-57e598e7-ab30-4389-9a38-dabc6b10e352 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:13.911504 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-57e598e7-ab30-4389-9a38-dabc6b10e352 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:13.912284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-57e598e7-ab30-4389-9a38-dabc6b10e352 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:13.912747 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-57e598e7-ab30-4389-9a38-dabc6b10e352 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:14.046398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-57e598e7-ab30-4389-9a38-dabc6b10e352 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:14.055028 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-57e598e7-ab30-4389-9a38-dabc6b10e352 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1366 microversion: 2.1 time: 0.155676 May 26 14:00:14.055603 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 605/1187] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:13 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:15.072172 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-70ad72be-0a46-4a02-8363-839508406299 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:15.072847 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-70ad72be-0a46-4a02-8363-839508406299 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:15.079301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70ad72be-0a46-4a02-8363-839508406299 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:15.079795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70ad72be-0a46-4a02-8363-839508406299 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.080606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70ad72be-0a46-4a02-8363-839508406299 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:15.081044 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-70ad72be-0a46-4a02-8363-839508406299 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:15.215797 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-70ad72be-0a46-4a02-8363-839508406299 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:15.223267 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-70ad72be-0a46-4a02-8363-839508406299 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1366 microversion: 2.1 time: 0.155003 May 26 14:00:15.223835 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 583/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:15 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:16.240244 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-05fb6767-488e-4289-bbde-7b1735b1063e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:16.241023 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-05fb6767-488e-4289-bbde-7b1735b1063e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:16.247410 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-05fb6767-488e-4289-bbde-7b1735b1063e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.247854 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-05fb6767-488e-4289-bbde-7b1735b1063e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.248721 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-05fb6767-488e-4289-bbde-7b1735b1063e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.249190 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-05fb6767-488e-4289-bbde-7b1735b1063e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.382636 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-05fb6767-488e-4289-bbde-7b1735b1063e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:16.390114 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-05fb6767-488e-4289-bbde-7b1735b1063e tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1366 microversion: 2.1 time: 0.154028 May 26 14:00:16.390681 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 606/1189] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:16 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:16.411763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-53963dc9-3413-4528-a2c3-c6df94f8df3a req-0a5cd160-6618-40f4-895c-d873b943cb3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535acfc4-e895-4532-a6b4-5155bf29ee93", "name": "network-vif-plugged", "status": "completed", "tag": "d5b45128-eac9-4421-bc8a-3d7ad0b10646"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:16.421304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-53963dc9-3413-4528-a2c3-c6df94f8df3a req-0a5cd160-6618-40f4-895c-d873b943cb3e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:16.421795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-53963dc9-3413-4528-a2c3-c6df94f8df3a req-0a5cd160-6618-40f4-895c-d873b943cb3e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:16.433034 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-53963dc9-3413-4528-a2c3-c6df94f8df3a req-0a5cd160-6618-40f4-895c-d873b943cb3e service nova] Creating event network-vif-plugged:d5b45128-eac9-4421-bc8a-3d7ad0b10646 for instance 535acfc4-e895-4532-a6b4-5155bf29ee93 on hv-cinder-81966 May 26 14:00:16.437898 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-53963dc9-3413-4528-a2c3-c6df94f8df3a req-0a5cd160-6618-40f4-895c-d873b943cb3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029949 May 26 14:00:16.438502 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 584/1190] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:17.408489 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-654617ed-6e38-461a-8bce-34bdcc0a0874 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:17.409132 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-654617ed-6e38-461a-8bce-34bdcc0a0874 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:17.415541 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-654617ed-6e38-461a-8bce-34bdcc0a0874 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:17.415983 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-654617ed-6e38-461a-8bce-34bdcc0a0874 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:17.416778 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-654617ed-6e38-461a-8bce-34bdcc0a0874 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:17.417209 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-654617ed-6e38-461a-8bce-34bdcc0a0874 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:17.550764 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-654617ed-6e38-461a-8bce-34bdcc0a0874 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:17.558112 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-654617ed-6e38-461a-8bce-34bdcc0a0874 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1366 microversion: 2.1 time: 0.153622 May 26 14:00:17.558673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 607/1191] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:17 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:18.572631 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:18.573414 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:18.577778 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-57abd813-2ad3-4691-9b08-d1491e7372f0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:18.578475 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-57abd813-2ad3-4691-9b08-d1491e7372f0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:18.586529 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57abd813-2ad3-4691-9b08-d1491e7372f0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.587014 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57abd813-2ad3-4691-9b08-d1491e7372f0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.587785 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57abd813-2ad3-4691-9b08-d1491e7372f0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.588223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-57abd813-2ad3-4691-9b08-d1491e7372f0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.722884 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-57abd813-2ad3-4691-9b08-d1491e7372f0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:00:18.730393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-57abd813-2ad3-4691-9b08-d1491e7372f0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1554 microversion: 2.1 time: 0.159178 May 26 14:00:18.730957 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 585/1192] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:00:18 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:00:18.746799 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ee380de4-9b3c-49b4-b2b2-c4432d537370 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:00:18.747351 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ee380de4-9b3c-49b4-b2b2-c4432d537370 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:00:18.749233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=6 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:00:18.755534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee380de4-9b3c-49b4-b2b2-c4432d537370 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.755984 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee380de4-9b3c-49b4-b2b2-c4432d537370 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.756811 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee380de4-9b3c-49b4-b2b2-c4432d537370 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:18.757240 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ee380de4-9b3c-49b4-b2b2-c4432d537370 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:18.835111 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ee380de4-9b3c-49b4-b2b2-c4432d537370 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091887 May 26 14:00:18.835937 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 608/1193] 10.222.0.16 () {58 vars in 1274 bytes} [Thu May 26 14:00:18 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:00:19.795859 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-18cde2a5-e6e9-4b3c-b6f9-67aa3868c77f req-03e4944b-1771-41d6-9936-9b0ddcd03c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "535acfc4-e895-4532-a6b4-5155bf29ee93", "tag": "d5b45128-eac9-4421-bc8a-3d7ad0b10646"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:00:19.804136 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-18cde2a5-e6e9-4b3c-b6f9-67aa3868c77f req-03e4944b-1771-41d6-9936-9b0ddcd03c5e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:00:19.804627 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-18cde2a5-e6e9-4b3c-b6f9-67aa3868c77f req-03e4944b-1771-41d6-9936-9b0ddcd03c5e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:00:19.815847 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-18cde2a5-e6e9-4b3c-b6f9-67aa3868c77f req-03e4944b-1771-41d6-9936-9b0ddcd03c5e service nova] Creating event network-changed:d5b45128-eac9-4421-bc8a-3d7ad0b10646 for instance 535acfc4-e895-4532-a6b4-5155bf29ee93 on hv-cinder-81966 May 26 14:00:19.821064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-18cde2a5-e6e9-4b3c-b6f9-67aa3868c77f req-03e4944b-1771-41d6-9936-9b0ddcd03c5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084275 May 26 14:00:19.821695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 586/1194] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:12.492602 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:12.493856 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:12.495231 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:12.496166 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:12.500213 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-fbca55fd-f357-449d-9b2e-dc1ba26176c2 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:12.500496 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-836d6e0a-ce58-45f0-9257-2c8a2fefcac3 req-42c9dc54-35b9-49ee-873c-bde48a213f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a211c6e1-d293-4f55-b321-4d4a4b1f0459", "tag": "e58634cf-9a7b-4f26-bfa5-33d613e98bab"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:12.501328 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fbca55fd-f357-449d-9b2e-dc1ba26176c2 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:12.511130 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fbca55fd-f357-449d-9b2e-dc1ba26176c2 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:12.512007 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fbca55fd-f357-449d-9b2e-dc1ba26176c2 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:12.512817 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-836d6e0a-ce58-45f0-9257-2c8a2fefcac3 req-42c9dc54-35b9-49ee-873c-bde48a213f9d service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:12.513240 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-836d6e0a-ce58-45f0-9257-2c8a2fefcac3 req-42c9dc54-35b9-49ee-873c-bde48a213f9d service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:12.513363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fbca55fd-f357-449d-9b2e-dc1ba26176c2 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:12.513994 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-fbca55fd-f357-449d-9b2e-dc1ba26176c2 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:12.531404 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-836d6e0a-ce58-45f0-9257-2c8a2fefcac3 req-42c9dc54-35b9-49ee-873c-bde48a213f9d service nova] Creating event network-changed:e58634cf-9a7b-4f26-bfa5-33d613e98bab for instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 on hv-cinder-81966 May 26 14:01:12.538191 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-836d6e0a-ce58-45f0-9257-2c8a2fefcac3 req-42c9dc54-35b9-49ee-873c-bde48a213f9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044003 May 26 14:01:12.538886 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 587/1195] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:12.552407 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-fbca55fd-f357-449d-9b2e-dc1ba26176c2 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:01:12.642376 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-fbca55fd-f357-449d-9b2e-dc1ba26176c2 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 204 len: 0 microversion: 2.1 time: 0.150932 May 26 14:01:12.643479 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 609/1196] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:01:12 2022] DELETE /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:01:12.654111 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-aa676248-f76d-47b1-9ddb-d846feca3820 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:12.654821 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-aa676248-f76d-47b1-9ddb-d846feca3820 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:12.661717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa676248-f76d-47b1-9ddb-d846feca3820 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:12.662204 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa676248-f76d-47b1-9ddb-d846feca3820 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:12.662983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa676248-f76d-47b1-9ddb-d846feca3820 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:12.663445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-aa676248-f76d-47b1-9ddb-d846feca3820 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:12.822557 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-aa676248-f76d-47b1-9ddb-d846feca3820 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:12.830911 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-aa676248-f76d-47b1-9ddb-d846feca3820 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1575 microversion: 2.1 time: 0.182655 May 26 14:01:12.831508 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 588/1197] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:12 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:13.849024 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c92fd02e-a61e-4792-b467-4e8d4dd6d7df tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:13.849754 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c92fd02e-a61e-4792-b467-4e8d4dd6d7df tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:13.856609 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c92fd02e-a61e-4792-b467-4e8d4dd6d7df tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:13.857083 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c92fd02e-a61e-4792-b467-4e8d4dd6d7df tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:13.857887 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c92fd02e-a61e-4792-b467-4e8d4dd6d7df tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:13.858361 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c92fd02e-a61e-4792-b467-4e8d4dd6d7df tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:14.027847 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-c92fd02e-a61e-4792-b467-4e8d4dd6d7df tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:14.036195 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c92fd02e-a61e-4792-b467-4e8d4dd6d7df tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1575 microversion: 2.1 time: 0.191706 May 26 14:01:14.036835 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 610/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:13 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:14.956195 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-6d126064-e5c3-4abb-91d6-db528cdca333 req-53c11196-d9b7-41c4-af8b-abced8166e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a211c6e1-d293-4f55-b321-4d4a4b1f0459", "name": "network-vif-deleted", "tag": "e58634cf-9a7b-4f26-bfa5-33d613e98bab"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:14.969845 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-6d126064-e5c3-4abb-91d6-db528cdca333 req-53c11196-d9b7-41c4-af8b-abced8166e29 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:14.971261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-6d126064-e5c3-4abb-91d6-db528cdca333 req-53c11196-d9b7-41c4-af8b-abced8166e29 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:14.985530 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-6d126064-e5c3-4abb-91d6-db528cdca333 req-53c11196-d9b7-41c4-af8b-abced8166e29 service nova] Creating event network-vif-deleted:e58634cf-9a7b-4f26-bfa5-33d613e98bab for instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 on hv-cinder-81966 May 26 14:01:14.990392 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-6d126064-e5c3-4abb-91d6-db528cdca333 req-53c11196-d9b7-41c4-af8b-abced8166e29 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039360 May 26 14:01:14.991001 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 589/1199] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:15.054757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-635e390a-05ab-4d4e-aa0d-39b72798bd4c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:15.055358 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-635e390a-05ab-4d4e-aa0d-39b72798bd4c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:15.061750 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-635e390a-05ab-4d4e-aa0d-39b72798bd4c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:15.062186 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-635e390a-05ab-4d4e-aa0d-39b72798bd4c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:15.062934 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-635e390a-05ab-4d4e-aa0d-39b72798bd4c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:15.063364 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-635e390a-05ab-4d4e-aa0d-39b72798bd4c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:15.124112 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-635e390a-05ab-4d4e-aa0d-39b72798bd4c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:15.132972 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-635e390a-05ab-4d4e-aa0d-39b72798bd4c tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 200 len: 1222 microversion: 2.1 time: 0.082255 May 26 14:01:15.133610 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 611/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:15 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:01:16.151576 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:16.152268 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a211c6e1-d293-4f55-b321-4d4a4b1f0459] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:16.159582 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:16.160054 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:16.161925 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:16.162370 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:16.176121 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] HTTP exception thrown: Instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 could not be found. May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Request method failure captured: May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 HTTP/1.1 May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4ZX-KNVL4bl-_ODI3RHYmU_cx3-FHO3GzBS0_m729ZTFxo6mFOiPrkaPwcF1XMnYpFWwM2JbSYLxFR0vsbWcIY2HyO1_HKuCTa4snoYm876U0FPEWZRNPezQVIM6ZdCib0jOgum03tyQfuTBflGZJf0B-HqywGna7yi69czg0v6dOQ May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:01:16.177765 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_189885bf9a5944bf8eaedd89bb5bec9f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-TestVolumeBootPattern-1168914393-project May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: f98684788906448bb3b35af5a2fc017f May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-TestVolumeBootPattern-1168914393-project May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 could not be found. May 26 14:01:16.179443 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'a211c6e1-d293-4f55-b321-4d4a4b1f0459'} May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 could not be found. May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:16.180480 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 could not be found. May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 could not be found. May 26 14:01:16.182076 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:16.183665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Returning 404 to user: Instance a211c6e1-d293-4f55-b321-4d4a4b1f0459 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:16.183665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9d1f2311-566c-4523-90f4-f73ec25b5472 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459" status: 404 len: 111 microversion: 2.1 time: 0.032326 May 26 14:01:16.183665 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 590/1201] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:16 2022] GET /compute/v2.1/servers/a211c6e1-d293-4f55-b321-4d4a4b1f0459 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:19.239698 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-b5a8b280-c0cd-404b-aeb3-e636aa663822 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:19.240227 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b5a8b280-c0cd-404b-aeb3-e636aa663822 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:19.241261 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-4a7df25c-7531-460e-ac36-0855a1fea9a3 req-934035c7-6787-4056-84c9-b2f845d420f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542be9eb-1123-48c5-a719-6f0ab71e41f8", "tag": "4051c928-b3ec-4074-8a3e-df0e1508b5a0"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:19.247260 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5a8b280-c0cd-404b-aeb3-e636aa663822 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:19.247796 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5a8b280-c0cd-404b-aeb3-e636aa663822 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:19.248676 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5a8b280-c0cd-404b-aeb3-e636aa663822 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:19.249181 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-b5a8b280-c0cd-404b-aeb3-e636aa663822 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:19.250223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-4a7df25c-7531-460e-ac36-0855a1fea9a3 req-934035c7-6787-4056-84c9-b2f845d420f2 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:19.250670 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-4a7df25c-7531-460e-ac36-0855a1fea9a3 req-934035c7-6787-4056-84c9-b2f845d420f2 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:19.262597 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-4a7df25c-7531-460e-ac36-0855a1fea9a3 req-934035c7-6787-4056-84c9-b2f845d420f2 service nova] Creating event network-changed:4051c928-b3ec-4074-8a3e-df0e1508b5a0 for instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 on hv-cinder-81966 May 26 14:01:19.268223 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-4a7df25c-7531-460e-ac36-0855a1fea9a3 req-934035c7-6787-4056-84c9-b2f845d420f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030531 May 26 14:01:19.269848 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 591/1202] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:01:19.276188 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-b5a8b280-c0cd-404b-aeb3-e636aa663822 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:01:19.359403 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-b5a8b280-c0cd-404b-aeb3-e636aa663822 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 204 len: 0 microversion: 2.1 time: 0.123921 May 26 14:01:19.360289 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 612/1203] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:01:19 2022] DELETE /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:01:19.369840 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c4563081-da53-4e3d-949a-2240bbc4b73b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:19.370895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c4563081-da53-4e3d-949a-2240bbc4b73b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:19.378436 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4563081-da53-4e3d-949a-2240bbc4b73b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:19.379363 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4563081-da53-4e3d-949a-2240bbc4b73b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:19.380498 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4563081-da53-4e3d-949a-2240bbc4b73b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:19.381138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c4563081-da53-4e3d-949a-2240bbc4b73b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:19.545200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-c4563081-da53-4e3d-949a-2240bbc4b73b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:19.553612 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c4563081-da53-4e3d-949a-2240bbc4b73b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1577 microversion: 2.1 time: 0.188756 May 26 14:01:19.554202 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 592/1204] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:19 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:20.571673 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e0874df1-195a-4e96-9536-947e7a023f3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:20.572292 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e0874df1-195a-4e96-9536-947e7a023f3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:20.579037 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0874df1-195a-4e96-9536-947e7a023f3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:20.580267 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0874df1-195a-4e96-9536-947e7a023f3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:20.581090 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0874df1-195a-4e96-9536-947e7a023f3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:20.581533 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e0874df1-195a-4e96-9536-947e7a023f3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:20.719982 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-e0874df1-195a-4e96-9536-947e7a023f3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:20.727658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e0874df1-195a-4e96-9536-947e7a023f3b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1577 microversion: 2.1 time: 0.160390 May 26 14:01:20.728233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 613/1205] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:20 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:21.745667 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-43c90a42-0383-4da6-817b-8a708229e658 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:21.746280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-43c90a42-0383-4da6-817b-8a708229e658 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:21.752695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43c90a42-0383-4da6-817b-8a708229e658 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:21.753141 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43c90a42-0383-4da6-817b-8a708229e658 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:21.753926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43c90a42-0383-4da6-817b-8a708229e658 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:21.754351 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-43c90a42-0383-4da6-817b-8a708229e658 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:21.836182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-16a5ef1c-af82-4b99-8ead-bdfda5690e71 req-bfd6f662-7fce-43d8-a9a9-a0d69c2fa824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542be9eb-1123-48c5-a719-6f0ab71e41f8", "name": "network-vif-deleted", "tag": "4051c928-b3ec-4074-8a3e-df0e1508b5a0"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:21.837868 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-43c90a42-0383-4da6-817b-8a708229e658 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98684788906448bb3b35af5a2fc017f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189885bf9a5944bf8eaedd89bb5bec9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:21.846105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-43c90a42-0383-4da6-817b-8a708229e658 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 200 len: 1390 microversion: 2.1 time: 0.104634 May 26 14:01:21.847593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-16a5ef1c-af82-4b99-8ead-bdfda5690e71 req-bfd6f662-7fce-43d8-a9a9-a0d69c2fa824 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:21.848038 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-16a5ef1c-af82-4b99-8ead-bdfda5690e71 req-bfd6f662-7fce-43d8-a9a9-a0d69c2fa824 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:21.849909 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 593/1206] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:21 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 1390 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:21.860383 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-16a5ef1c-af82-4b99-8ead-bdfda5690e71 req-bfd6f662-7fce-43d8-a9a9-a0d69c2fa824 service nova] Creating event network-vif-deleted:4051c928-b3ec-4074-8a3e-df0e1508b5a0 for instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 on hv-cinder-81966 May 26 14:01:21.865354 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-16a5ef1c-af82-4b99-8ead-bdfda5690e71 req-bfd6f662-7fce-43d8-a9a9-a0d69c2fa824 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033050 May 26 14:01:21.865885 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 614/1207] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:01:22.867663 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:22.868259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: 542be9eb-1123-48c5-a719-6f0ab71e41f8] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:22.874798 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:22.875241 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:22.876002 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:22.876705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:22.890128 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] HTTP exception thrown: Instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 could not be found. May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Request method failure captured: May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 HTTP/1.1 May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4ZX-KNVL4bl-_ODI3RHYmU_cx3-FHO3GzBS0_m729ZTFxo6mFOiPrkaPwcF1XMnYpFWwM2JbSYLxFR0vsbWcIY2HyO1_HKuCTa4snoYm876U0FPEWZRNPezQVIM6ZdCib0jOgum03tyQfuTBflGZJf0B-HqywGna7yi69czg0v6dOQ May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:01:22.892248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_189885bf9a5944bf8eaedd89bb5bec9f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-TestVolumeBootPattern-1168914393-project May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: f98684788906448bb3b35af5a2fc017f May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-TestVolumeBootPattern-1168914393-project May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 could not be found. May 26 14:01:22.893824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '542be9eb-1123-48c5-a719-6f0ab71e41f8'} May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 could not be found. May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:22.894614 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 could not be found. May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 could not be found. May 26 14:01:22.896174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:22.897610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Returning 404 to user: Instance 542be9eb-1123-48c5-a719-6f0ab71e41f8 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:22.897610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2fb6b7a0-41ca-4a2d-9786-40a7588b8c63 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8" status: 404 len: 111 microversion: 2.1 time: 0.030176 May 26 14:01:22.897610 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 594/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:22 2022] GET /compute/v2.1/servers/542be9eb-1123-48c5-a719-6f0ab71e41f8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:23.332893 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:23.333482 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:23.339947 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:23.340530 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:23.341320 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:23.341756 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:23.354840 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] HTTP exception thrown: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Request method failure captured: May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: DELETE /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 HTTP/1.1 May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4ZX-KNVL4bl-_ODI3RHYmU_cx3-FHO3GzBS0_m729ZTFxo6mFOiPrkaPwcF1XMnYpFWwM2JbSYLxFR0vsbWcIY2HyO1_HKuCTa4snoYm876U0FPEWZRNPezQVIM6ZdCib0jOgum03tyQfuTBflGZJf0B-HqywGna7yi69czg0v6dOQ May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 14:01:23.356497 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_189885bf9a5944bf8eaedd89bb5bec9f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-TestVolumeBootPattern-1168914393-project May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: f98684788906448bb3b35af5a2fc017f May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-TestVolumeBootPattern-1168914393-project May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.358087 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'a2f0c112-3ce9-43ea-8c2b-421193107cd2'} May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:23.358913 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.360149 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:23.362022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Returning 404 to user: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:23.362022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-ca40e765-2655-4a6c-bccf-bdafa3c4324b tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 404 len: 111 microversion: 2.1 time: 0.030571 May 26 14:01:23.362022 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 615/1209] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:01:23 2022] DELETE /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:23.366592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:23.367201 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] [instance: a2f0c112-3ce9-43ea-8c2b-421193107cd2] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:23.373607 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:23.374060 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:23.374824 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:23.375263 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:23.389145 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] HTTP exception thrown: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Request method failure captured: May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 HTTP/1.1 May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4ZX-KNVL4bl-_ODI3RHYmU_cx3-FHO3GzBS0_m729ZTFxo6mFOiPrkaPwcF1XMnYpFWwM2JbSYLxFR0vsbWcIY2HyO1_HKuCTa4snoYm876U0FPEWZRNPezQVIM6ZdCib0jOgum03tyQfuTBflGZJf0B-HqywGna7yi69czg0v6dOQ May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:01:23.390573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_189885bf9a5944bf8eaedd89bb5bec9f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/189885bf9a5944bf8eaedd89bb5bec9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 189885bf9a5944bf8eaedd89bb5bec9f May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-TestVolumeBootPattern-1168914393 May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-TestVolumeBootPattern-1168914393-project May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: f98684788906448bb3b35af5a2fc017f May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-TestVolumeBootPattern-1168914393-project May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.392953 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'a2f0c112-3ce9-43ea-8c2b-421193107cd2'} May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:23.393984 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. May 26 14:01:23.395445 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:23.397134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Returning 404 to user: Instance a2f0c112-3ce9-43ea-8c2b-421193107cd2 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:23.397134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-9422a65f-a117-4de3-a28d-723f5b1cf44f tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2" status: 404 len: 111 microversion: 2.1 time: 0.029200 May 26 14:01:23.397134 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 595/1210] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:23 2022] GET /compute/v2.1/servers/a2f0c112-3ce9-43ea-8c2b-421193107cd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:24.688265 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d63c4a12-110d-4b65-b224-d5bf5eb10e25 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] Calling method '.version_select at 0x7f07e0324430>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:24.707401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d63c4a12-110d-4b65-b224-d5bf5eb10e25 tempest-TestVolumeBootPattern-1168914393 tempest-TestVolumeBootPattern-1168914393-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-18808065" status: 202 len: 0 microversion: 2.1 time: 0.022878 May 26 14:01:24.707981 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 616/1211] 10.222.0.16 () {58 vars in 1256 bytes} [Thu May 26 14:01:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-18808065 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:01:35.097671 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-3318b586-567a-47de-ba9d-fef0d918d716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:35.098252 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-3318b586-567a-47de-ba9d-fef0d918d716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:35.100773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=18 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:35.101401 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=30 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:35.106732 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3318b586-567a-47de-ba9d-fef0d918d716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:35.107174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3318b586-567a-47de-ba9d-fef0d918d716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:35.107923 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3318b586-567a-47de-ba9d-fef0d918d716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:35.108374 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-3318b586-567a-47de-ba9d-fef0d918d716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:35.131786 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-3318b586-567a-47de-ba9d-fef0d918d716 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/ips" status: 200 len: 147 microversion: 2.1 time: 0.038416 May 26 14:01:35.132415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 596/1212] 10.222.0.16 () {58 vars in 1247 bytes} [Thu May 26 14:01:35 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:36.449415 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:36.450219 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:01:36.455491 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-15963497-01d5-4ae9-8ae2-f959043a9737 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d05e36e-e2fb-4c4c-9438-b05c9d8ee75d"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:36.456570 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-15963497-01d5-4ae9-8ae2-f959043a9737 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:36.468200 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15963497-01d5-4ae9-8ae2-f959043a9737 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:36.468672 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15963497-01d5-4ae9-8ae2-f959043a9737 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:36.469432 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15963497-01d5-4ae9-8ae2-f959043a9737 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:36.469872 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-15963497-01d5-4ae9-8ae2-f959043a9737 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:36.706946 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-15963497-01d5-4ae9-8ae2-f959043a9737 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "POST /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258878 May 26 14:01:36.713331 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 617/1213] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 14:01:36 2022] POST /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:43.279529 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0b834b65-9277-4baa-9c6e-93299afd93c0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:43.280091 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0b834b65-9277-4baa-9c6e-93299afd93c0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:43.286972 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b834b65-9277-4baa-9c6e-93299afd93c0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:43.287413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b834b65-9277-4baa-9c6e-93299afd93c0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:43.288174 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b834b65-9277-4baa-9c6e-93299afd93c0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:43.288666 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b834b65-9277-4baa-9c6e-93299afd93c0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:43.373878 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-0b834b65-9277-4baa-9c6e-93299afd93c0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lazy-loading 'services' on Instance uuid 535acfc4-e895-4532-a6b4-5155bf29ee93 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:01:43.446669 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0b834b65-9277-4baa-9c6e-93299afd93c0 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-volume_attachments/9d05e36e-e2fb-4c4c-9438-b05c9d8ee75d" status: 202 len: 0 microversion: 2.1 time: 0.170809 May 26 14:01:43.447181 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 597/1214] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 14:01:43 2022] DELETE /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-volume_attachments/9d05e36e-e2fb-4c4c-9438-b05c9d8ee75d => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 14:01:43.458654 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-92876a62-7e83-440a-a880-25d1309a3895 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:43.459735 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-92876a62-7e83-440a-a880-25d1309a3895 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:43.466661 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-92876a62-7e83-440a-a880-25d1309a3895 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:43.467141 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-92876a62-7e83-440a-a880-25d1309a3895 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:43.467923 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-92876a62-7e83-440a-a880-25d1309a3895 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:43.468385 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-92876a62-7e83-440a-a880-25d1309a3895 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:43.499047 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-92876a62-7e83-440a-a880-25d1309a3895 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046119 May 26 14:01:43.501222 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 618/1215] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 14:01:43 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:44.512578 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-7a95e424-9331-4137-8f44-83dd055fba0b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:44.513570 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-7a95e424-9331-4137-8f44-83dd055fba0b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:44.520228 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a95e424-9331-4137-8f44-83dd055fba0b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:44.520695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a95e424-9331-4137-8f44-83dd055fba0b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:44.521449 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a95e424-9331-4137-8f44-83dd055fba0b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:44.521877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-7a95e424-9331-4137-8f44-83dd055fba0b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:44.551227 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-7a95e424-9331-4137-8f44-83dd055fba0b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043374 May 26 14:01:44.551782 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 598/1216] 10.222.0.16 () {58 vars in 1301 bytes} [Thu May 26 14:01:44 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:01:44.616205 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-e778905e-3a7b-4bc0-9c61-652d413c3afb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:44.618476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e778905e-3a7b-4bc0-9c61-652d413c3afb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:44.623401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e778905e-3a7b-4bc0-9c61-652d413c3afb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:44.623967 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e778905e-3a7b-4bc0-9c61-652d413c3afb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:44.624866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e778905e-3a7b-4bc0-9c61-652d413c3afb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:44.625297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-e778905e-3a7b-4bc0-9c61-652d413c3afb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:44.656726 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-e778905e-3a7b-4bc0-9c61-652d413c3afb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:01:44.736513 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-e778905e-3a7b-4bc0-9c61-652d413c3afb tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 204 len: 0 microversion: 2.1 time: 0.123554 May 26 14:01:44.737130 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 619/1217] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:01:44 2022] DELETE /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:01:44.745390 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-21b17919-944f-436d-91c2-209365fc676b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:44.746022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-21b17919-944f-436d-91c2-209365fc676b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:44.752237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21b17919-944f-436d-91c2-209365fc676b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:44.752724 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21b17919-944f-436d-91c2-209365fc676b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:44.753468 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21b17919-944f-436d-91c2-209365fc676b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:44.753898 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-21b17919-944f-436d-91c2-209365fc676b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:44.890286 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-21b17919-944f-436d-91c2-209365fc676b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:44.898422 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-21b17919-944f-436d-91c2-209365fc676b tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1678 microversion: 2.1 time: 0.156869 May 26 14:01:44.898980 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 599/1218] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:44 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:45.923152 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-942b09c4-eb7c-415d-9bf7-5ff21ae79ec1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:45.923880 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-942b09c4-eb7c-415d-9bf7-5ff21ae79ec1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:45.930417 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-942b09c4-eb7c-415d-9bf7-5ff21ae79ec1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:45.930866 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-942b09c4-eb7c-415d-9bf7-5ff21ae79ec1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:45.931634 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-942b09c4-eb7c-415d-9bf7-5ff21ae79ec1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:45.932071 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-942b09c4-eb7c-415d-9bf7-5ff21ae79ec1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:46.066323 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-942b09c4-eb7c-415d-9bf7-5ff21ae79ec1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:46.073740 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-942b09c4-eb7c-415d-9bf7-5ff21ae79ec1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1678 microversion: 2.1 time: 0.155041 May 26 14:01:46.074299 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 620/1219] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:45 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:47.092090 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-27419502-977b-45fc-8148-ae4796b5cee5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:47.092661 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-27419502-977b-45fc-8148-ae4796b5cee5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:47.099862 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27419502-977b-45fc-8148-ae4796b5cee5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:47.100361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27419502-977b-45fc-8148-ae4796b5cee5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:47.101177 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27419502-977b-45fc-8148-ae4796b5cee5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:47.101654 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-27419502-977b-45fc-8148-ae4796b5cee5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:47.175304 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-27419502-977b-45fc-8148-ae4796b5cee5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae843854dccd4c28a260d040be460db0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b596535d63d6490eb939c300bfe565cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:01:47.182932 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-27419502-977b-45fc-8148-ae4796b5cee5 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 200 len: 1610 microversion: 2.1 time: 0.094815 May 26 14:01:47.183512 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 600/1220] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:47 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 1610 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:01:47.676689 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-1b5d9be7-632e-48af-8bcb-5967f977b71e req-f2b3c3c1-f30a-4e45-b9e5-3d9ea0e4c567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "535acfc4-e895-4532-a6b4-5155bf29ee93", "name": "network-vif-deleted", "tag": "d5b45128-eac9-4421-bc8a-3d7ad0b10646"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:01:47.684928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-1b5d9be7-632e-48af-8bcb-5967f977b71e req-f2b3c3c1-f30a-4e45-b9e5-3d9ea0e4c567 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:47.685376 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-1b5d9be7-632e-48af-8bcb-5967f977b71e req-f2b3c3c1-f30a-4e45-b9e5-3d9ea0e4c567 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:47.696965 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-1b5d9be7-632e-48af-8bcb-5967f977b71e req-f2b3c3c1-f30a-4e45-b9e5-3d9ea0e4c567 service nova] Creating event network-vif-deleted:d5b45128-eac9-4421-bc8a-3d7ad0b10646 for instance 535acfc4-e895-4532-a6b4-5155bf29ee93 on hv-cinder-81966 May 26 14:01:47.701897 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-1b5d9be7-632e-48af-8bcb-5967f977b71e req-f2b3c3c1-f30a-4e45-b9e5-3d9ea0e4c567 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263926 May 26 14:01:47.702499 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 621/1221] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:01:48.200567 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:48.201303 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:48.208358 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:48.208806 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:48.209587 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:48.210022 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:48.224906 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 HTTP/1.1 May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:01:48.226549 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:48.229272 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '535acfc4-e895-4532-a6b4-5155bf29ee93'} May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:48.230986 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:48.233738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:48.236650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:48.236650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-59399e57-75ff-4bb5-a2ba-00168663ed24 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 404 len: 111 microversion: 2.1 time: 0.031310 May 26 14:01:48.236650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 601/1222] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:48 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:48.238212 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-de407b88-ba8a-4074-8d22-1fc4e308c9c1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '.version_select at 0x7f07e0330ee0>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:48.257297 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-de407b88-ba8a-4074-8d22-1fc4e308c9c1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717716847" status: 202 len: 0 microversion: 2.1 time: 0.023710 May 26 14:01:48.258627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 622/1223] 10.222.0.16 () {58 vars in 1217 bytes} [Thu May 26 14:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717716847 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 14:01:50.007644 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:50.008161 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:50.014583 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:50.015026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:50.015833 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:50.016248 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:50.029552 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 HTTP/1.1 May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:01:50.031068 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.033313 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '535acfc4-e895-4532-a6b4-5155bf29ee93'} May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:50.034114 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.035407 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:50.037153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:50.037153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-81e1a8e2-e1e0-4873-9b37-d9abc3865a2c tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 404 len: 111 microversion: 2.1 time: 0.029170 May 26 14:01:50.037153 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 602/1224] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:01:50 2022] DELETE /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:50.042665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:50.043421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: 535acfc4-e895-4532-a6b4-5155bf29ee93] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:50.050268 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:50.050720 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:50.051486 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:50.051927 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:50.065566 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 HTTP/1.1 May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 14:01:50.067233 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.068806 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '535acfc4-e895-4532-a6b4-5155bf29ee93'} May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:50.069687 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. May 26 14:01:50.071100 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:50.072398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance 535acfc4-e895-4532-a6b4-5155bf29ee93 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:50.072398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3e3586f9-c545-454a-ba4d-0ef464952ed2 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93" status: 404 len: 111 microversion: 2.1 time: 0.030414 May 26 14:01:50.072398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 623/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:50 2022] GET /compute/v2.1/servers/535acfc4-e895-4532-a6b4-5155bf29ee93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:51.203105 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:51.203892 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:51.210409 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.210895 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.212003 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.212389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.226120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e HTTP/1.1 May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:01:51.227685 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.229276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'c048a6df-4889-4011-a072-70b3c965b14e'} May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:51.230247 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.231561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.232936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:51.232936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-857fc996-0afe-4db2-975b-c577bba42568 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 404 len: 111 microversion: 2.1 time: 0.030222 May 26 14:01:51.232936 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 603/1226] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:01:51 2022] DELETE /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:51.238631 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:51.239237 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: c048a6df-4889-4011-a072-70b3c965b14e] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:51.245746 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.246185 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.246943 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.247372 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.264070 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e HTTP/1.1 May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 14:01:51.265618 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.267398 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'c048a6df-4889-4011-a072-70b3c965b14e'} May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:51.268549 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. May 26 14:01:51.269985 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.271325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance c048a6df-4889-4011-a072-70b3c965b14e could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:51.271325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-740bbfa7-f3e4-4f74-acdb-37ea49dec979 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e" status: 404 len: 111 microversion: 2.1 time: 0.032825 May 26 14:01:51.271325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 624/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:51 2022] GET /compute/v2.1/servers/c048a6df-4889-4011-a072-70b3c965b14e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:51.275511 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:51.276009 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:51.282345 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.282889 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.283660 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.284211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.297891 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 HTTP/1.1 May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:01:51.299413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.301006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70'} May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:51.302037 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.303522 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:51.305064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:51.305064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64dfcd75-7b13-4176-b137-5c491540c1b1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 404 len: 111 microversion: 2.1 time: 0.029211 May 26 14:01:51.305064 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 604/1228] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:01:51 2022] DELETE /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:51.309657 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:51.310266 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:51.317321 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.317770 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.318584 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:51.318997 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:51.337280 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 HTTP/1.1 May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 14:01:51.338873 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.340477 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70'} May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:51.341434 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. May 26 14:01:51.342860 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:51.344501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:51.344501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a3d82bc8-114d-4a8b-b7c3-6823bc91574a tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70" status: 404 len: 111 microversion: 2.1 time: 0.034514 May 26 14:01:51.344501 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 625/1229] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:51 2022] GET /compute/v2.1/servers/aa08cafd-c1b6-4cd5-abc3-b5e5af87cd70 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 14:01:52.477745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:52.478273 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:52.484719 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:52.485632 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:52.486391 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:52.486826 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:52.500052 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: DELETE /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 HTTP/1.1 May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:01:52.502113 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.503770 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': 'bcc7bf48-e03b-4fd7-9e81-3c61c7395271'} May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:52.504695 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.506259 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:01:52.507800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:52.507800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-c00143da-1290-4119-81ab-2336df41a83d tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 404 len: 111 microversion: 2.1 time: 0.029557 May 26 14:01:52.507800 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 605/1230] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:01:52 2022] DELETE /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:01:52.511995 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:01:52.512646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] [instance: bcc7bf48-e03b-4fd7-9e81-3c61c7395271] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:01:52.520097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:52.520579 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:52.521363 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:01:52.521789 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:01:52.535695 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] HTTP exception thrown: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Request method failure captured: May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 HTTP/1.1 May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4bAnWk39SLnhKpBphOHfJK9umXJNhvVgq0R77-DTLu9tdr_c6t18_kYoB8S0L9F0E_M_Rr-yBgbHLEhFjGHWKxuapemNxkeuQZ9EmK_a6IKO50krsV-4HU51Ko4VjBcxNwjj9aSAS0nLiuyfRA7Edj8w29NsupqG70hbi2etsftw1A May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 14:01:52.537249 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b596535d63d6490eb939c300bfe565cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b596535d63d6490eb939c300bfe565cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: b596535d63d6490eb939c300bfe565cf May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1539736558 May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: ae843854dccd4c28a260d040be460db0 May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-AttachVolumeNegativeTest-1539736558-project May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.538834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': 'bcc7bf48-e03b-4fd7-9e81-3c61c7395271'} May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:01:52.539725 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. May 26 14:01:52.541234 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:01:52.542627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] Returning 404 to user: Instance bcc7bf48-e03b-4fd7-9e81-3c61c7395271 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:01:52.542627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-76c3c92c-c759-4f4d-bc79-56320ca223f1 tempest-AttachVolumeNegativeTest-1539736558 tempest-AttachVolumeNegativeTest-1539736558-project] 10.222.0.16 "GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271" status: 404 len: 111 microversion: 2.1 time: 0.030425 May 26 14:01:52.542627 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 626/1231] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:01:52 2022] GET /compute/v2.1/servers/bcc7bf48-e03b-4fd7-9e81-3c61c7395271 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 14:02:57.758026 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=20 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:57.758753 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:57.762606 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1194739042", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "networks": [{"uuid": "d8ffdd3d-5c95-48db-854d-6cecab9a5e9a"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:02:57.813543 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] validate_networks() for [('d8ffdd3d-5c95-48db-854d-6cecab9a5e9a', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:02:58.223708 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:02:58.224180 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:02:58.224792 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:02:58.225200 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:02:58.225604 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:02:58.234639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:58.235079 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.235893 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:58.236341 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:58.254164 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Getting quotas for project 260fdce225db48d0b5a3205ecdce2f0c. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:02:58.258280 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Getting quotas for user 22e89c62438b464fa49c08d606101ee9 and project 260fdce225db48d0b5a3205ecdce2f0c. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:02:58.269293 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:02:58.272351 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:02:58.318619 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-5c3a8803-b4b4-406b-a2bb-ec6f8357c1c2 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562442 May 26 14:02:58.319834 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 606/1232] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 14:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:02:58.327905 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:58.328728 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:02:58.333890 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-7c8c938a-8df1-4759-a851-c02f6087526c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:58.334523 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-7c8c938a-8df1-4759-a851-c02f6087526c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:58.407645 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-7c8c938a-8df1-4759-a851-c02f6087526c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:58.415269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-7c8c938a-8df1-4759-a851-c02f6087526c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1219 microversion: 2.1 time: 0.089333 May 26 14:02:58.415848 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 627/1233] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:02:58 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:02:59.435811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-fcbddf28-e98a-485c-9883-7f3be96b2a76 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:02:59.437073 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-fcbddf28-e98a-485c-9883-7f3be96b2a76 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:02:59.445446 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcbddf28-e98a-485c-9883-7f3be96b2a76 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:59.445978 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcbddf28-e98a-485c-9883-7f3be96b2a76 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:59.446751 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcbddf28-e98a-485c-9883-7f3be96b2a76 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:02:59.447195 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-fcbddf28-e98a-485c-9883-7f3be96b2a76 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:02:59.568630 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-fcbddf28-e98a-485c-9883-7f3be96b2a76 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:02:59.576316 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-fcbddf28-e98a-485c-9883-7f3be96b2a76 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1289 microversion: 2.1 time: 0.147218 May 26 14:02:59.577166 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 607/1234] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:02:59 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1289 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:00.594626 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f6d5cb70-705b-412a-a858-64a7da25f747 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:00.595344 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f6d5cb70-705b-412a-a858-64a7da25f747 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:00.602045 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6d5cb70-705b-412a-a858-64a7da25f747 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:00.602593 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6d5cb70-705b-412a-a858-64a7da25f747 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:00.603426 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6d5cb70-705b-412a-a858-64a7da25f747 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:00.603935 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6d5cb70-705b-412a-a858-64a7da25f747 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:00.754834 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f6d5cb70-705b-412a-a858-64a7da25f747 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:00.763053 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f6d5cb70-705b-412a-a858-64a7da25f747 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1319 microversion: 2.1 time: 0.172232 May 26 14:03:00.772472 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 628/1235] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:00 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:00.800399 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-105406cb-aec4-4010-a336-9369f9bfb9f8 req-eb81e111-62cd-4169-ab14-95961a3643d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0dac3a-63b1-4bcd-accd-cfe1edc7a006", "tag": "3ed0e081-f9c9-4330-941a-27d55e8b5533"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:00.813152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-105406cb-aec4-4010-a336-9369f9bfb9f8 req-eb81e111-62cd-4169-ab14-95961a3643d5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:00.813811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-105406cb-aec4-4010-a336-9369f9bfb9f8 req-eb81e111-62cd-4169-ab14-95961a3643d5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:00.826283 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-105406cb-aec4-4010-a336-9369f9bfb9f8 req-eb81e111-62cd-4169-ab14-95961a3643d5 service nova] Creating event network-changed:3ed0e081-f9c9-4330-941a-27d55e8b5533 for instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 on hv-cinder-81966 May 26 14:03:00.831176 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-105406cb-aec4-4010-a336-9369f9bfb9f8 req-eb81e111-62cd-4169-ab14-95961a3643d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037982 May 26 14:03:00.831926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 608/1236] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:01.793254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4b0860ae-e3f5-4074-b430-5b9b108500fd tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:01.793254 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4b0860ae-e3f5-4074-b430-5b9b108500fd tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:01.798198 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4b0860ae-e3f5-4074-b430-5b9b108500fd tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:01.799016 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4b0860ae-e3f5-4074-b430-5b9b108500fd tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:01.800273 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4b0860ae-e3f5-4074-b430-5b9b108500fd tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:01.800752 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4b0860ae-e3f5-4074-b430-5b9b108500fd tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:01.958665 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4b0860ae-e3f5-4074-b430-5b9b108500fd tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:01.967615 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4b0860ae-e3f5-4074-b430-5b9b108500fd tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1319 microversion: 2.1 time: 0.182044 May 26 14:03:01.968217 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 629/1237] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:01 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:02.986562 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-26140dc0-8fde-4a81-bf05-f7986d09cd86 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:02.987251 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-26140dc0-8fde-4a81-bf05-f7986d09cd86 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:02.994110 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26140dc0-8fde-4a81-bf05-f7986d09cd86 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:02.994563 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26140dc0-8fde-4a81-bf05-f7986d09cd86 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:02.995338 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26140dc0-8fde-4a81-bf05-f7986d09cd86 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:02.995777 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-26140dc0-8fde-4a81-bf05-f7986d09cd86 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:03.251348 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-26140dc0-8fde-4a81-bf05-f7986d09cd86 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:03.260503 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-26140dc0-8fde-4a81-bf05-f7986d09cd86 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1319 microversion: 2.1 time: 0.278382 May 26 14:03:03.261135 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 609/1238] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:02 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:04.278255 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-4f6ad745-622f-443b-a985-9f97238a3b73 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:04.279042 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-4f6ad745-622f-443b-a985-9f97238a3b73 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:04.286141 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4f6ad745-622f-443b-a985-9f97238a3b73 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:04.287303 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4f6ad745-622f-443b-a985-9f97238a3b73 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.287933 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4f6ad745-622f-443b-a985-9f97238a3b73 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:04.288410 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-4f6ad745-622f-443b-a985-9f97238a3b73 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:04.438269 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-4f6ad745-622f-443b-a985-9f97238a3b73 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:04.446401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-4f6ad745-622f-443b-a985-9f97238a3b73 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1319 microversion: 2.1 time: 0.172257 May 26 14:03:04.446977 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 630/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:04 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:05.465688 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-53c1d592-9a4d-44bc-91d9-1855e02402ad tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:05.466346 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-53c1d592-9a4d-44bc-91d9-1855e02402ad tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:05.474848 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53c1d592-9a4d-44bc-91d9-1855e02402ad tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:05.475377 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53c1d592-9a4d-44bc-91d9-1855e02402ad tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:05.476322 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53c1d592-9a4d-44bc-91d9-1855e02402ad tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:05.477004 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-53c1d592-9a4d-44bc-91d9-1855e02402ad tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:05.656021 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-53c1d592-9a4d-44bc-91d9-1855e02402ad tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:05.666450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-53c1d592-9a4d-44bc-91d9-1855e02402ad tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1319 microversion: 2.1 time: 0.205117 May 26 14:03:05.667276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 610/1240] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:05 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:06.689538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-cc981fd8-0f6a-4213-902c-f7dabd7aca8a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:06.690166 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-cc981fd8-0f6a-4213-902c-f7dabd7aca8a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:06.698097 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cc981fd8-0f6a-4213-902c-f7dabd7aca8a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:06.698559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cc981fd8-0f6a-4213-902c-f7dabd7aca8a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:06.699330 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cc981fd8-0f6a-4213-902c-f7dabd7aca8a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:06.699767 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-cc981fd8-0f6a-4213-902c-f7dabd7aca8a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:06.841244 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-cc981fd8-0f6a-4213-902c-f7dabd7aca8a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:06.849614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-cc981fd8-0f6a-4213-902c-f7dabd7aca8a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1319 microversion: 2.1 time: 0.163579 May 26 14:03:06.849940 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 631/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:06 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:07.307019 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-1ebfe3ab-488d-4d85-88b5-5ddf14579cfa req-e01bead2-8811-4455-bdcc-0518c1c209ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0dac3a-63b1-4bcd-accd-cfe1edc7a006", "name": "network-vif-plugged", "status": "completed", "tag": "3ed0e081-f9c9-4330-941a-27d55e8b5533"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:07.315977 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-1ebfe3ab-488d-4d85-88b5-5ddf14579cfa req-e01bead2-8811-4455-bdcc-0518c1c209ab service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:07.316451 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-1ebfe3ab-488d-4d85-88b5-5ddf14579cfa req-e01bead2-8811-4455-bdcc-0518c1c209ab service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:07.329030 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-1ebfe3ab-488d-4d85-88b5-5ddf14579cfa req-e01bead2-8811-4455-bdcc-0518c1c209ab service nova] Creating event network-vif-plugged:3ed0e081-f9c9-4330-941a-27d55e8b5533 for instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 on hv-cinder-81966 May 26 14:03:07.334260 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-1ebfe3ab-488d-4d85-88b5-5ddf14579cfa req-e01bead2-8811-4455-bdcc-0518c1c209ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166586 May 26 14:03:07.334872 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 611/1242] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:07.866483 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0a766b1f-5c88-44c1-9be9-02b24d7473be tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:07.867207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0a766b1f-5c88-44c1-9be9-02b24d7473be tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:07.874446 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0a766b1f-5c88-44c1-9be9-02b24d7473be tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:07.874892 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0a766b1f-5c88-44c1-9be9-02b24d7473be tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:07.875684 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0a766b1f-5c88-44c1-9be9-02b24d7473be tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:07.876117 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0a766b1f-5c88-44c1-9be9-02b24d7473be tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:08.063093 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0a766b1f-5c88-44c1-9be9-02b24d7473be tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:08.071043 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0a766b1f-5c88-44c1-9be9-02b24d7473be tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1319 microversion: 2.1 time: 0.208447 May 26 14:03:08.071614 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 632/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:07 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:09.089500 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-0b4709c5-13b0-4595-9f30-57876cf69187 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:09.090118 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-0b4709c5-13b0-4595-9f30-57876cf69187 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:09.092632 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:09.093504 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:09.100717 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b4709c5-13b0-4595-9f30-57876cf69187 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.101254 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b4709c5-13b0-4595-9f30-57876cf69187 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.101963 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b4709c5-13b0-4595-9f30-57876cf69187 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:09.102393 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-0b4709c5-13b0-4595-9f30-57876cf69187 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:09.283715 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-0b4709c5-13b0-4595-9f30-57876cf69187 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:09.292179 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-0b4709c5-13b0-4595-9f30-57876cf69187 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1319 microversion: 2.1 time: 0.207218 May 26 14:03:09.292811 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 612/1244] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:09 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:10.310538 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f8e0ec71-e3d8-4611-87bf-a301b0d7c8a5 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:10.311172 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f8e0ec71-e3d8-4611-87bf-a301b0d7c8a5 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:10.313129 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:10.319923 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec71-e3d8-4611-87bf-a301b0d7c8a5 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:10.320396 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec71-e3d8-4611-87bf-a301b0d7c8a5 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:10.321176 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec71-e3d8-4611-87bf-a301b0d7c8a5 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:10.321606 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f8e0ec71-e3d8-4611-87bf-a301b0d7c8a5 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:10.471178 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-f8e0ec71-e3d8-4611-87bf-a301b0d7c8a5 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:10.479048 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f8e0ec71-e3d8-4611-87bf-a301b0d7c8a5 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1508 microversion: 2.1 time: 0.172386 May 26 14:03:10.479647 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 633/1245] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:10 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:14.181245 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:03:14.181816 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Thu May 26 14:03:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:03:29.067761 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6b035e1d-55f1-4fc9-8b65-6bfae085f1a6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1234f448-3127-4677-aaa0-0d311b4aab77", "device": "/dev/sdb"}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:03:29.069964 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6b035e1d-55f1-4fc9-8b65-6bfae085f1a6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:29.072010 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:29.072816 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=30 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:29.079212 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b035e1d-55f1-4fc9-8b65-6bfae085f1a6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:29.079670 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b035e1d-55f1-4fc9-8b65-6bfae085f1a6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:29.080825 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b035e1d-55f1-4fc9-8b65-6bfae085f1a6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:29.081631 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6b035e1d-55f1-4fc9-8b65-6bfae085f1a6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:29.350536 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6b035e1d-55f1-4fc9-8b65-6bfae085f1a6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "POST /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289613 May 26 14:03:29.351388 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 613/1246] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 14:03:29 2022] POST /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:03:31.019207 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:03:31.019824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Thu May 26 14:03:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:03:56.139502 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-233fb121-7ed3-4be8-9a40-c98cd842cdcc tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:56.140174 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-233fb121-7ed3-4be8-9a40-c98cd842cdcc tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:56.142027 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=16 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:56.142726 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=36 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:56.148757 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-233fb121-7ed3-4be8-9a40-c98cd842cdcc tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:56.149204 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-233fb121-7ed3-4be8-9a40-c98cd842cdcc tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:56.149969 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-233fb121-7ed3-4be8-9a40-c98cd842cdcc tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:56.150401 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-233fb121-7ed3-4be8-9a40-c98cd842cdcc tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:56.232412 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-233fb121-7ed3-4be8-9a40-c98cd842cdcc tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lazy-loading 'services' on Instance uuid 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:03:56.304731 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-233fb121-7ed3-4be8-9a40-c98cd842cdcc tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006/os-volume_attachments/1234f448-3127-4677-aaa0-0d311b4aab77" status: 202 len: 0 microversion: 2.1 time: 0.169969 May 26 14:03:56.305322 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 634/1247] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 14:03:56 2022] DELETE /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006/os-volume_attachments/1234f448-3127-4677-aaa0-0d311b4aab77 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:03:57.418998 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:57.419756 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:03:57.423745 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-f4b95b19-be6d-4f5c-a7fb-4e7e30dea320 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:57.424348 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f4b95b19-be6d-4f5c-a7fb-4e7e30dea320 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:57.432092 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4b95b19-be6d-4f5c-a7fb-4e7e30dea320 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:57.432573 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4b95b19-be6d-4f5c-a7fb-4e7e30dea320 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:57.433339 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4b95b19-be6d-4f5c-a7fb-4e7e30dea320 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:57.433773 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-f4b95b19-be6d-4f5c-a7fb-4e7e30dea320 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:57.461663 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-f4b95b19-be6d-4f5c-a7fb-4e7e30dea320 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Going to try to terminate instance {{(pid=124241) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:03:57.537341 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-f4b95b19-be6d-4f5c-a7fb-4e7e30dea320 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 204 len: 0 microversion: 2.1 time: 0.119289 May 26 14:03:57.538757 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 614/1248] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:03:57 2022] DELETE /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:03:57.547187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-a22b7d07-f457-4d39-9001-52d3e075b61c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:57.547893 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-a22b7d07-f457-4d39-9001-52d3e075b61c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:57.554894 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a22b7d07-f457-4d39-9001-52d3e075b61c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:57.555332 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a22b7d07-f457-4d39-9001-52d3e075b61c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:57.556102 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a22b7d07-f457-4d39-9001-52d3e075b61c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:57.556598 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-a22b7d07-f457-4d39-9001-52d3e075b61c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:57.688130 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-a22b7d07-f457-4d39-9001-52d3e075b61c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:57.696068 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-a22b7d07-f457-4d39-9001-52d3e075b61c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1514 microversion: 2.1 time: 0.153104 May 26 14:03:57.696674 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 635/1249] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:57 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:03:58.714366 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06af20eb-1166-492d-bf3a-143ad43605eb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:58.715119 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06af20eb-1166-492d-bf3a-143ad43605eb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:58.722198 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06af20eb-1166-492d-bf3a-143ad43605eb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:58.722823 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06af20eb-1166-492d-bf3a-143ad43605eb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:58.723509 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06af20eb-1166-492d-bf3a-143ad43605eb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:58.723948 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06af20eb-1166-492d-bf3a-143ad43605eb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:58.855107 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06af20eb-1166-492d-bf3a-143ad43605eb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:03:58.862592 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06af20eb-1166-492d-bf3a-143ad43605eb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1514 microversion: 2.1 time: 0.152735 May 26 14:03:58.863176 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 615/1250] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:58 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:03:59.879813 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-3de40665-5335-4847-a7b9-f30a5782d178 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:03:59.880557 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-3de40665-5335-4847-a7b9-f30a5782d178 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:03:59.887096 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3de40665-5335-4847-a7b9-f30a5782d178 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:59.887540 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3de40665-5335-4847-a7b9-f30a5782d178 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:03:59.888325 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3de40665-5335-4847-a7b9-f30a5782d178 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:03:59.888772 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-3de40665-5335-4847-a7b9-f30a5782d178 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.036658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-3de40665-5335-4847-a7b9-f30a5782d178 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:00.045528 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-3de40665-5335-4847-a7b9-f30a5782d178 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 200 len: 1514 microversion: 2.1 time: 0.169585 May 26 14:04:00.046208 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 636/1251] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:03:59 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:00.063667 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-4614e36b-0664-48dd-8e5e-94a4d3710620 req-ed3d9dcc-f613-489b-aa1c-3a493e26ec2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0dac3a-63b1-4bcd-accd-cfe1edc7a006", "name": "network-vif-deleted", "tag": "3ed0e081-f9c9-4330-941a-27d55e8b5533"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:00.073589 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-4614e36b-0664-48dd-8e5e-94a4d3710620 req-ed3d9dcc-f613-489b-aa1c-3a493e26ec2d service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:00.074032 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-4614e36b-0664-48dd-8e5e-94a4d3710620 req-ed3d9dcc-f613-489b-aa1c-3a493e26ec2d service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:00.087008 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-4614e36b-0664-48dd-8e5e-94a4d3710620 req-ed3d9dcc-f613-489b-aa1c-3a493e26ec2d service nova] Creating event network-vif-deleted:3ed0e081-f9c9-4330-941a-27d55e8b5533 for instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 on hv-cinder-81966 May 26 14:04:00.093413 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-4614e36b-0664-48dd-8e5e-94a4d3710620 req-ed3d9dcc-f613-489b-aa1c-3a493e26ec2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 May 26 14:04:00.094024 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 616/1252] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:01.067447 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:01.068049 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:01.076745 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:01.077196 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:01.077973 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:01.078467 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:01.092488 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.wsgi [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] HTTP exception thrown: Instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 could not be found. May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Request method failure captured: May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: request: GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 HTTP/1.1 May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept: application/json May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Accept-Encoding: identity May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Connection: close May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Length: 0 May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Content-Type: application/json May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Host: 10.222.0.16 May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Openstack-System-Scope: None May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: User-Agent: python-urllib3/1.26.9 May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Auth-Token: gAAAAABij4iQGrdDD7wgDsteB1L0V5BuQtPFX9vdn8FppcXWGv_xZBS_UZ092Hm6NUnzPgV2aZBlVJps636MmV8TnASrfJj4z6d_Y_i642kDgd_GEdMMvkZpDbWMJww7hu1-CSU9sTc9mL8vPce9406m245M1dX4pwhatESOkfALVNolio3_aL4 May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Id: None May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Domain-Name: None May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Identity-Status: Confirmed May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Is-Admin-Project: True May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Id: default May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Domain-Name: Default May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Id: 260fdce225db48d0b5a3205ecdce2f0c May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Project-Name: tempest-VolumesSnapshotTestJSON-774437233 May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Role: reader,member May 26 14:04:01.094131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Roles: reader,member May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_260fdce225db48d0b5a3205ecdce2f0c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/260fdce225db48d0b5a3205ecdce2f0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/260fdce225db48d0b5a3205ecdce2f0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/260fdce225db48d0b5a3205ecdce2f0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant: tempest-VolumesSnapshotTestJSON-774437233 May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Id: 260fdce225db48d0b5a3205ecdce2f0c May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-774437233 May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User: tempest-VolumesSnapshotTestJSON-774437233-project May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Id: default May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Domain-Name: Default May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Id: 22e89c62438b464fa49c08d606101ee9 May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: X-User-Name: tempest-VolumesSnapshotTestJSON-774437233-project May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: method: > May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: exception: Instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 could not be found. May 26 14:04:01.095926 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: action_args: {'id': '4b0dac3a-63b1-4bcd-accd-cfe1edc7a006'} May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 could not be found. May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:04:01.097278 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 could not be found. May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 could not be found. May 26 14:04:01.098928 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: ERROR nova.api.openstack.wsgi May 26 14:04:01.101107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Returning 404 to user: Instance 4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 could not be found. {{(pid=124240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:04:01.101107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c9fadaa8-92c9-49d5-a08d-6739a33f232d tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006" status: 404 len: 111 microversion: 2.1 time: 0.032017 May 26 14:04:01.101107 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 637/1253] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:01 2022] GET /compute/v2.1/servers/4b0dac3a-63b1-4bcd-accd-cfe1edc7a006 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:04:10.915438 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-971806515", "imageRef": "60945a3a-33b7-4b13-ab1f-0703b539dbe8", "flavorRef": "452", "networks": [{"uuid": "d8ffdd3d-5c95-48db-854d-6cecab9a5e9a"}]}} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:10.922719 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:10.923361 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:10.971262 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.network.neutron [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] validate_networks() for [('d8ffdd3d-5c95-48db-854d-6cecab9a5e9a', None, None, None, None, None)] {{(pid=124241) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 14:04:11.316751 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Flavor limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 14:04:11.317169 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Image limits 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 14:04:11.317639 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Flavor pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 14:04:11.318045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Image pref 0:0:0 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 14:04:11.319151 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.virt.hardware [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 14:04:11.327859 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:11.328326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:11.329120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:11.329558 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:11.346651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Getting quotas for project 260fdce225db48d0b5a3205ecdce2f0c. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 14:04:11.350561 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.quota [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Getting quotas for user 22e89c62438b464fa49c08d606101ee9 and project 260fdce225db48d0b5a3205ecdce2f0c. Resources: {'instances', 'cores', 'ram'} {{(pid=124241) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 14:04:11.361220 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Going to run 1 instances... {{(pid=124241) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 14:04:11.363692 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60945a3a-33b7-4b13-ab1f-0703b539dbe8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124241) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 14:04:11.409288 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-6525f8a1-02ef-4c9c-bdc2-ede073788039 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498427 May 26 14:04:11.409945 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 617/1254] 10.222.0.16 () {60 vars in 1146 bytes} [Thu May 26 14:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:04:11.420182 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-711f21d5-1aae-4fbf-ab26-e218f500352b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:11.420823 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-711f21d5-1aae-4fbf-ab26-e218f500352b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:11.424079 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=8 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:11.425020 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:11.480804 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-711f21d5-1aae-4fbf-ab26-e218f500352b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:11.487578 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-711f21d5-1aae-4fbf-ab26-e218f500352b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1218 microversion: 2.1 time: 0.071248 May 26 14:04:11.488228 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 638/1255] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:11 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:12.504701 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-06761fe4-f9a8-4a3b-bedf-d785fa085603 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:12.505408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-06761fe4-f9a8-4a3b-bedf-d785fa085603 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:12.513531 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06761fe4-f9a8-4a3b-bedf-d785fa085603 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:12.514062 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06761fe4-f9a8-4a3b-bedf-d785fa085603 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:12.514905 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06761fe4-f9a8-4a3b-bedf-d785fa085603 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:12.515415 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-06761fe4-f9a8-4a3b-bedf-d785fa085603 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:12.591237 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-06761fe4-f9a8-4a3b-bedf-d785fa085603 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:12.598726 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-06761fe4-f9a8-4a3b-bedf-d785fa085603 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1276 microversion: 2.1 time: 0.097856 May 26 14:04:12.599618 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 618/1256] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:12 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:13.610780 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-edfd0814-d89c-46a0-a525-86e5667251b1 req-3d7035f9-62c2-43f0-b691-227b39674b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81bbb651-8f5d-4ac3-83a6-28887d53c751", "tag": "ca7ed358-a21b-4ed7-b98f-eb33d54522a4"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:13.617466 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-64c5cbbd-923d-4bf5-a8d1-df9340000c1a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:13.624902 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-edfd0814-d89c-46a0-a525-86e5667251b1 req-3d7035f9-62c2-43f0-b691-227b39674b5e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:13.625451 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-edfd0814-d89c-46a0-a525-86e5667251b1 req-3d7035f9-62c2-43f0-b691-227b39674b5e service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:13.627161 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-64c5cbbd-923d-4bf5-a8d1-df9340000c1a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:13.635158 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64c5cbbd-923d-4bf5-a8d1-df9340000c1a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:13.635795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64c5cbbd-923d-4bf5-a8d1-df9340000c1a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:13.636802 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64c5cbbd-923d-4bf5-a8d1-df9340000c1a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:13.637416 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-64c5cbbd-923d-4bf5-a8d1-df9340000c1a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:13.637835 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-edfd0814-d89c-46a0-a525-86e5667251b1 req-3d7035f9-62c2-43f0-b691-227b39674b5e service nova] Creating event network-changed:ca7ed358-a21b-4ed7-b98f-eb33d54522a4 for instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 on hv-cinder-81966 May 26 14:04:13.642786 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-edfd0814-d89c-46a0-a525-86e5667251b1 req-3d7035f9-62c2-43f0-b691-227b39674b5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036620 May 26 14:04:13.643411 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 639/1257] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:13.846957 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-64c5cbbd-923d-4bf5-a8d1-df9340000c1a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:13.855066 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-64c5cbbd-923d-4bf5-a8d1-df9340000c1a tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1318 microversion: 2.1 time: 0.242303 May 26 14:04:13.855650 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 619/1258] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:13 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:14.873701 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-dc9d846c-c419-4aff-b905-b8927055fb1c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:14.874409 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-dc9d846c-c419-4aff-b905-b8927055fb1c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:14.880658 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc9d846c-c419-4aff-b905-b8927055fb1c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.881824 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc9d846c-c419-4aff-b905-b8927055fb1c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:14.882619 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc9d846c-c419-4aff-b905-b8927055fb1c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:14.883063 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-dc9d846c-c419-4aff-b905-b8927055fb1c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:15.012545 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-dc9d846c-c419-4aff-b905-b8927055fb1c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:15.019964 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-dc9d846c-c419-4aff-b905-b8927055fb1c tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1318 microversion: 2.1 time: 0.150942 May 26 14:04:15.020568 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 640/1259] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:14 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:16.037575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-2f839cd8-edc1-41ff-9009-aaa9edac4ba6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:16.038211 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-2f839cd8-edc1-41ff-9009-aaa9edac4ba6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:16.044802 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f839cd8-edc1-41ff-9009-aaa9edac4ba6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:16.045250 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f839cd8-edc1-41ff-9009-aaa9edac4ba6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:16.046018 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f839cd8-edc1-41ff-9009-aaa9edac4ba6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:16.046453 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-2f839cd8-edc1-41ff-9009-aaa9edac4ba6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:16.305129 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-2f839cd8-edc1-41ff-9009-aaa9edac4ba6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:16.312651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-2f839cd8-edc1-41ff-9009-aaa9edac4ba6 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1318 microversion: 2.1 time: 0.279395 May 26 14:04:16.313225 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 620/1260] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:16 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:17.331163 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-0ec04c15-5328-436c-9921-2dbe57c31766 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:17.332128 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-0ec04c15-5328-436c-9921-2dbe57c31766 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:17.339891 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ec04c15-5328-436c-9921-2dbe57c31766 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:17.340374 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ec04c15-5328-436c-9921-2dbe57c31766 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:17.341159 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ec04c15-5328-436c-9921-2dbe57c31766 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:17.341596 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-0ec04c15-5328-436c-9921-2dbe57c31766 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:17.490921 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-0ec04c15-5328-436c-9921-2dbe57c31766 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:17.498551 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-0ec04c15-5328-436c-9921-2dbe57c31766 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1318 microversion: 2.1 time: 0.172215 May 26 14:04:17.499124 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 641/1261] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:17 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:18.516526 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-b2584562-c27b-4868-a5c1-3c116ace62fb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:18.517138 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-b2584562-c27b-4868-a5c1-3c116ace62fb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:18.528706 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2584562-c27b-4868-a5c1-3c116ace62fb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.529229 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2584562-c27b-4868-a5c1-3c116ace62fb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.530702 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2584562-c27b-4868-a5c1-3c116ace62fb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:18.531429 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-b2584562-c27b-4868-a5c1-3c116ace62fb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:18.677688 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-b2584562-c27b-4868-a5c1-3c116ace62fb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:18.685983 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-b2584562-c27b-4868-a5c1-3c116ace62fb tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1318 microversion: 2.1 time: 0.173217 May 26 14:04:18.686554 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 621/1262] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:18 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:04:19.396858 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [req-e93e9f95-306c-40e6-be65-927f4047dff9 req-a78b5eb1-5cd5-4134-b093-5d9930db8a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bbb651-8f5d-4ac3-83a6-28887d53c751", "name": "network-vif-plugged", "status": "completed", "tag": "ca7ed358-a21b-4ed7-b98f-eb33d54522a4"}]} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:19.405842 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e93e9f95-306c-40e6-be65-927f4047dff9 req-a78b5eb1-5cd5-4134-b093-5d9930db8a07 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:19.406029 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [req-e93e9f95-306c-40e6-be65-927f4047dff9 req-a78b5eb1-5cd5-4134-b093-5d9930db8a07 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:19.418443 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.compute.server_external_events [req-e93e9f95-306c-40e6-be65-927f4047dff9 req-a78b5eb1-5cd5-4134-b093-5d9930db8a07 service nova] Creating event network-vif-plugged:ca7ed358-a21b-4ed7-b98f-eb33d54522a4 for instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 on hv-cinder-81966 May 26 14:04:19.424396 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [req-e93e9f95-306c-40e6-be65-927f4047dff9 req-a78b5eb1-5cd5-4134-b093-5d9930db8a07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031178 May 26 14:04:19.424989 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 642/1263] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:19.703117 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e3781b7f-35d9-4291-ba9a-531cdd6b0132 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:19.703711 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e3781b7f-35d9-4291-ba9a-531cdd6b0132 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:19.710491 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3781b7f-35d9-4291-ba9a-531cdd6b0132 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:19.710877 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3781b7f-35d9-4291-ba9a-531cdd6b0132 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:19.711651 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3781b7f-35d9-4291-ba9a-531cdd6b0132 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:19.712090 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e3781b7f-35d9-4291-ba9a-531cdd6b0132 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:19.846389 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e3781b7f-35d9-4291-ba9a-531cdd6b0132 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:19.854725 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e3781b7f-35d9-4291-ba9a-531cdd6b0132 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1318 microversion: 2.1 time: 0.155440 May 26 14:04:19.855301 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 622/1264] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:19 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:20.873381 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-13bfe4ca-cdff-4ce9-b9b8-2b9ea0d6237b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:20.874165 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-13bfe4ca-cdff-4ce9-b9b8-2b9ea0d6237b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:20.881489 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-13bfe4ca-cdff-4ce9-b9b8-2b9ea0d6237b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:20.882012 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-13bfe4ca-cdff-4ce9-b9b8-2b9ea0d6237b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:20.882787 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-13bfe4ca-cdff-4ce9-b9b8-2b9ea0d6237b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:20.883223 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-13bfe4ca-cdff-4ce9-b9b8-2b9ea0d6237b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:21.015369 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-13bfe4ca-cdff-4ce9-b9b8-2b9ea0d6237b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:21.022762 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-13bfe4ca-cdff-4ce9-b9b8-2b9ea0d6237b tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1318 microversion: 2.1 time: 0.153910 May 26 14:04:21.023326 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 643/1265] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:20 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:22.039408 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e0c8b720-3c5b-4996-af56-0803b986e068 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:22.040016 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e0c8b720-3c5b-4996-af56-0803b986e068 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:22.041886 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=2 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:22.042539 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell0:SELECT=6 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:22.048828 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0c8b720-3c5b-4996-af56-0803b986e068 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:22.049276 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0c8b720-3c5b-4996-af56-0803b986e068 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:22.050047 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0c8b720-3c5b-4996-af56-0803b986e068 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:22.050488 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e0c8b720-3c5b-4996-af56-0803b986e068 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:22.179479 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-e0c8b720-3c5b-4996-af56-0803b986e068 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:22.186973 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e0c8b720-3c5b-4996-af56-0803b986e068 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1507 microversion: 2.1 time: 0.151635 May 26 14:04:22.187543 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 623/1266] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:22 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:22.204150 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-f6d8b804-917d-45f0-9113-66d11372ebee tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "931af1d7-0f8f-45b9-89db-53f6c32b7730", "device": "/dev/sdb"}} {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:22.205765 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-f6d8b804-917d-45f0-9113-66d11372ebee tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:22.207768 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell0:SELECT=2 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:22.213907 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6d8b804-917d-45f0-9113-66d11372ebee tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:22.214362 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6d8b804-917d-45f0-9113-66d11372ebee tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:22.215131 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6d8b804-917d-45f0-9113-66d11372ebee tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:22.215567 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-f6d8b804-917d-45f0-9113-66d11372ebee tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:22.453580 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-f6d8b804-917d-45f0-9113-66d11372ebee tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "POST /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253205 May 26 14:04:22.454187 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 644/1267] 10.222.0.16 () {60 vars in 1322 bytes} [Thu May 26 14:04:22 2022] POST /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:43.658703 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:04:43.659421 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Thu May 26 14:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:04:43.844867 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-e06e41a2-e762-4b1e-84f7-1f8a702c9d70 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:43.845381 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-e06e41a2-e762-4b1e-84f7-1f8a702c9d70 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:43.847795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:43.848564 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG dbcounter [-] [124241] Writing DB stats nova_cell1:SELECT=38 {{(pid=124241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:43.854766 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e06e41a2-e762-4b1e-84f7-1f8a702c9d70 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:43.855214 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e06e41a2-e762-4b1e-84f7-1f8a702c9d70 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:43.855976 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e06e41a2-e762-4b1e-84f7-1f8a702c9d70 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:43.856441 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-e06e41a2-e762-4b1e-84f7-1f8a702c9d70 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:43.938120 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.objects.instance [None req-e06e41a2-e762-4b1e-84f7-1f8a702c9d70 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lazy-loading 'services' on Instance uuid 81bbb651-8f5d-4ac3-83a6-28887d53c751 {{(pid=124241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:04:44.009968 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-e06e41a2-e762-4b1e-84f7-1f8a702c9d70 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751/os-volume_attachments/931af1d7-0f8f-45b9-89db-53f6c32b7730" status: 202 len: 0 microversion: 2.1 time: 0.168896 May 26 14:04:44.010588 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 624/1268] 10.222.0.16 () {58 vars in 1415 bytes} [Thu May 26 14:04:43 2022] DELETE /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751/os-volume_attachments/931af1d7-0f8f-45b9-89db-53f6c32b7730 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:04:45.130586 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_api:SELECT=16 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:45.131711 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG dbcounter [-] [124240] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 14:04:45.135864 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-c75ce878-3826-4014-80be-23799edabdaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:45.136476 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c75ce878-3826-4014-80be-23799edabdaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:45.143736 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c75ce878-3826-4014-80be-23799edabdaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.144199 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c75ce878-3826-4014-80be-23799edabdaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.144967 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c75ce878-3826-4014-80be-23799edabdaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.145402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-c75ce878-3826-4014-80be-23799edabdaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.172924 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-c75ce878-3826-4014-80be-23799edabdaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Going to try to terminate instance {{(pid=124240) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 14:04:45.250738 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-c75ce878-3826-4014-80be-23799edabdaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 204 len: 0 microversion: 2.1 time: 0.121649 May 26 14:04:45.251475 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 645/1269] 10.222.0.16 () {58 vars in 1238 bytes} [Thu May 26 14:04:45 2022] DELETE /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:04:45.261273 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-24136241-fe2d-43e8-8d7d-d8fa3a68abaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:45.263006 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-24136241-fe2d-43e8-8d7d-d8fa3a68abaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:45.268344 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24136241-fe2d-43e8-8d7d-d8fa3a68abaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.268795 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24136241-fe2d-43e8-8d7d-d8fa3a68abaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.269559 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24136241-fe2d-43e8-8d7d-d8fa3a68abaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:45.269996 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-24136241-fe2d-43e8-8d7d-d8fa3a68abaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:45.404229 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.policy [None req-24136241-fe2d-43e8-8d7d-d8fa3a68abaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124241) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:45.411996 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-24136241-fe2d-43e8-8d7d-d8fa3a68abaa tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1513 microversion: 2.1 time: 0.155457 May 26 14:04:45.412763 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 625/1270] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:45 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:46.432402 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-d588341b-a7e7-4597-b4bf-5aab56b6d3fe tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:46.433357 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-d588341b-a7e7-4597-b4bf-5aab56b6d3fe tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:46.440054 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d588341b-a7e7-4597-b4bf-5aab56b6d3fe tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:46.440560 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d588341b-a7e7-4597-b4bf-5aab56b6d3fe tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:46.441323 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d588341b-a7e7-4597-b4bf-5aab56b6d3fe tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:46.451428 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-d588341b-a7e7-4597-b4bf-5aab56b6d3fe tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:46.592646 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-d588341b-a7e7-4597-b4bf-5aab56b6d3fe tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:46.600534 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-d588341b-a7e7-4597-b4bf-5aab56b6d3fe tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1513 microversion: 2.1 time: 0.173855 May 26 14:04:46.601103 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 646/1271] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:46 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:47.366183 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [req-e85f36a2-f665-4ac1-8ff6-4c6c9531cbe4 req-abeab99d-9850-4027-9c86-0a43d80ac2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81bbb651-8f5d-4ac3-83a6-28887d53c751", "name": "network-vif-deleted", "tag": "ca7ed358-a21b-4ed7-b98f-eb33d54522a4"}]} {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:04:47.376835 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-e85f36a2-f665-4ac1-8ff6-4c6c9531cbe4 req-abeab99d-9850-4027-9c86-0a43d80ac2c5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:47.377450 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [req-e85f36a2-f665-4ac1-8ff6-4c6c9531cbe4 req-abeab99d-9850-4027-9c86-0a43d80ac2c5 service nova] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:47.389152 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.compute.server_external_events [req-e85f36a2-f665-4ac1-8ff6-4c6c9531cbe4 req-abeab99d-9850-4027-9c86-0a43d80ac2c5 service nova] Creating event network-vif-deleted:ca7ed358-a21b-4ed7-b98f-eb33d54522a4 for instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 on hv-cinder-81966 May 26 14:04:47.394738 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [req-e85f36a2-f665-4ac1-8ff6-4c6c9531cbe4 req-abeab99d-9850-4027-9c86-0a43d80ac2c5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033150 May 26 14:04:47.395326 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 626/1272] 10.222.0.16 () {64 vars in 1317 bytes} [Thu May 26 14:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:04:47.618073 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.api.openstack.wsgi [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:47.618628 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.compute.api [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124240) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:47.625147 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:47.625599 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:47.626370 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:47.626801 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:47.659641 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:47.660086 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG oslo_concurrency.lockutils [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:47.660559 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.objects.instance [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lazy-loading 'fault' on Instance uuid 81bbb651-8f5d-4ac3-83a6-28887d53c751 {{(pid=124240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 14:04:47.702372 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: DEBUG nova.policy [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e89c62438b464fa49c08d606101ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '260fdce225db48d0b5a3205ecdce2f0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124240) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:04:47.710543 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO nova.api.openstack.requestlog [None req-75e8d9fc-b4fd-457a-b9d6-d38c14d1dc36 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 200 len: 1308 microversion: 2.1 time: 0.096690 May 26 14:04:47.711122 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: [pid: 124240|app: 0|req: 647/1273] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:47 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:04:48.729926 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Calling method '>' {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:04:48.730642 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.compute.api [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] [instance: 81bbb651-8f5d-4ac3-83a6-28887d53c751] Fetching instance by UUID {{(pid=124241) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 14:04:48.741456 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:48.742159 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:48.743067 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 14:04:48.743498 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG oslo_concurrency.lockutils [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Lock "11d24607-eb88-459e-b6ca-9c71caaa8fb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 14:04:48.759034 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.wsgi [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] HTTP exception thrown: Instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 could not be found. May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Request method failure captured: May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: request: GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 HTTP/1.1 May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept: application/json May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Accept-Encoding: identity May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Connection: close May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Length: 0 May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Content-Type: application/json May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Host: 10.222.0.16 May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Openstack-System-Scope: None May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: User-Agent: python-urllib3/1.26.9 May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Auth-Token: gAAAAABij4iQGrdDD7wgDsteB1L0V5BuQtPFX9vdn8FppcXWGv_xZBS_UZ092Hm6NUnzPgV2aZBlVJps636MmV8TnASrfJj4z6d_Y_i642kDgd_GEdMMvkZpDbWMJww7hu1-CSU9sTc9mL8vPce9406m245M1dX4pwhatESOkfALVNolio3_aL4 May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Id: None May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Domain-Name: None May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Identity-Status: Confirmed May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Is-Admin-Project: True May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Id: default May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Domain-Name: Default May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Id: 260fdce225db48d0b5a3205ecdce2f0c May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Project-Name: tempest-VolumesSnapshotTestJSON-774437233 May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Role: reader,member May 26 14:04:48.760705 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Roles: reader,member May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_260fdce225db48d0b5a3205ecdce2f0c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/260fdce225db48d0b5a3205ecdce2f0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/260fdce225db48d0b5a3205ecdce2f0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/260fdce225db48d0b5a3205ecdce2f0c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}] May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant: tempest-VolumesSnapshotTestJSON-774437233 May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Id: 260fdce225db48d0b5a3205ecdce2f0c May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-774437233 May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User: tempest-VolumesSnapshotTestJSON-774437233-project May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Id: default May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Domain-Name: Default May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Id: 22e89c62438b464fa49c08d606101ee9 May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: X-User-Name: tempest-VolumesSnapshotTestJSON-774437233-project May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: method: > May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: exception: Instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 could not be found. May 26 14:04:48.762510 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: action_args: {'id': '81bbb651-8f5d-4ac3-83a6-28887d53c751'} May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: {{(pid=124241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 could not be found. May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 14:04:48.763768 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 could not be found. May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 could not be found. May 26 14:04:48.765534 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: ERROR nova.api.openstack.wsgi May 26 14:04:48.767045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: DEBUG nova.api.openstack.wsgi [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] Returning 404 to user: Instance 81bbb651-8f5d-4ac3-83a6-28887d53c751 could not be found. {{(pid=124241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 14:04:48.767045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO nova.api.openstack.requestlog [None req-66596f9e-0f0b-4409-a973-7e37934b0436 tempest-VolumesSnapshotTestJSON-774437233 tempest-VolumesSnapshotTestJSON-774437233-project] 10.222.0.16 "GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751" status: 404 len: 111 microversion: 2.1 time: 0.036821 May 26 14:04:48.767045 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: [pid: 124241|app: 0|req: 627/1274] 10.222.0.16 () {58 vars in 1235 bytes} [Thu May 26 14:04:48 2022] GET /compute/v2.1/servers/81bbb651-8f5d-4ac3-83a6-28887d53c751 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:06:34.189789 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:06:34.190659 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Thu May 26 14:06:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:06:51.028915 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:06:51.029514 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Thu May 26 14:06:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:08:03.667250 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:08:03.667961 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Thu May 26 14:08:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:09:45.333920 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:09:45.334569 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Thu May 26 14:09:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:09:54.198486 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:09:54.199575 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Thu May 26 14:09:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:10:08.158821 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:10:08.159548 dv-cinder-819668-4-iscsi devstack@n-api.service[124241]: Thu May 26 14:10:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:10:11.037284 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:10:11.037871 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Thu May 26 14:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 14:10:11.205436 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 14:10:11.205680 dv-cinder-819668-4-iscsi devstack@n-api.service[124240]: Thu May 26 14:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!